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PREFACE • 



The Emergency School Assistance Program (ESAP) provided financial! 

•^"aid to .schools during 1970-1971 and 3.971-1972 to help them'^in the pro- 

ce3S of achieving "successfol desegregation.-*^. The original evaluation 

of * the program's effect, .in the second year, indicated that blacJc male ' * 

l^Oth grafts in schools receiving the emergency aid did signif icant-ly ^ 

\ better on a test of academic performance -tjfean did similar students in ^ , 

* unfunded comparison' schools. * No program effects were reported for other 

group?> of students: 10th grade^ black f^ales, 10th grade whites (both " 

sexes).,* and 5th graders^ (all* four race-sex groups).. ^ . 

the analysis reported here ^ts an attempt to apcount for the program 

effect on bTack males^ Could the effect be better .explained by what the 

.choolt> di(^ with ESAP money or by changes brought .about in the attitudes 

an'l behavior of students or teachers? ^ 

The National Advisory Council on Equality of Educational Opportunity 
'* ^ ' ^ 

' (NACEEG). asked the Office of Educs^tion to pursue this- interesting result 

* , ^ 

wiTfi the aim of finding any useful information about the operation of" ^ 

^ESAA, the. successor to ESAP^ which thp council nionitored. ''The National 

Council knew that this secondary analysis would be^exploratory , not 

confirmatory, .in nature. This orientation is reflected in «11 stages of 

the work; th^' aim is to search for clues, not clear-cut certainties, 

abdi^t the existence and ^causes of program success. ^ ^ 

\ The Office of Kducation contracted with Rand for "the task of re- 

analysis. The work has been reported in two parts^. The first rt^ev^lu- 

ated the finding that ESAP resulted in better performance for bfeck mc2le 

students'. The second, reported here, seeks to explain how this effe^ct 

came about 
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40» At a time when many schools in the southern states were going ^ | 

through th'e transition from segregated to desegregated s'tatus, the " 

. ' ' •» * * ' • 

federal government initiated the Emergency School Assistaace Prog-ram 
c • • f 

(KSAR) to help them' through a difficult phase. The program supplied 

■* t • ' 

financi<7l^a^ist^nce* to target'schools , which, on average, increased, 

their- annual budget by estiihated 3 percent»<* This, funding paid "'fofr 

all sorts of activities that were aiithoriz'ed by the regulations with 

the' common, intention of meeting '^special n<^eds incident to the elimlna- 

tion of rac-ial segregation." 

- The program was administered, in part, on an experimental basis ^ 

» >• • I ^ * - ^ 

so' that wi/thin a set of *pomparable pair-s of schools some, chosen at 

rhndDm, receivedxthe funding while others ^'did not* It was therefore 

possible to investigate .the program's effect by '"comparing experimental 

and control' schools., T,he original evaluation ^ (NOFiC, 197^) showed that 

black male lOth'graders performed significantly better on' average, 

than similar students in the control schools. 

There are five issues addressed here: ^ 

(I) Did ESAP a]<ter the racial: climatcg;^,^ the funded schools? 

NORG had suggested, but not proved, that the -higher levels -of 
performance for black males was attributable to improvements^' in the. 
racial climate of Che ESAP-funded schools. This change cannot be 
defected vAth those data . (SeGtion II). ' But if the students are divided 
into four*groups (black males, black females, white males, white females) ^ 
it is found that ESAP had a dif f erential tef f ect. on students' attitudes 
and perceptions of their teachers and schools. However, these race and 
sex /linked ^fe'^^f fee ts do not impinge on the black 'males, so *the higher ^ 
achievement levels of black males eannot* be attributed to the inter- 
vening effect the program had on their attitudes. It is suggested that 
there was an indirect effect' that- worked on whi'te students who, in turn, 
influenced black males; but this , affords a tenuous explanation of how 
* ESAP workcid . . . 

«^ • 

-(2) Are thei^i relationships- between student educational performance • 
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an'd iioncognitive. variables (sucK as attitude to school work) that are 
dependent 'on his race and sex? * ^ * ^ - ^ 

The data include a large number of noncognitive variables — measures 
of a student's attitude to school, teachen<5, and -fellQw students^ and 
•hrs feelings of self-esteem* In Section IV these noncogn;Ltive -variables 
are 'rel*/jtejei to achievement levels for the four race-rse^ g^roups* The ^ 
strength and^ direction of 'these relationships .was fouTid to vaty across ^ 
the four groups, and in some instances "the variability promised Co ^ 
explain the 'higher performance le'Vels o/^ black males. Specifically, 
black s>tudents who felt race'was not linked to^^Q or who felt blacks 
were" **smar4" teji^d' to db better on the .ach':^e\^e?ffent Test. However, 
"other parts of the analysis could not link either ESAP funding or spe- 
ciflc educational programs'to these noncognitive variables. Therefore, 
while this part of • the analysis is suggestive cTf reasons f or athe per- • . 
formance levels of different race and sex groups,* the olues could not 

be conne'cted to a larger picture that included ESAP.., 

♦ 

' (3> What^did ESAP buy? • , ' * > ' 

Consistent with the diverse adtiv.iti6s authorized 6y ESAP i:egula- 
tions, schools were found to have used program money for all kinds of 
^fprograms Uind services. Analysis of this information in Sect^iqn V points 
*to several pfoblo^s in specifying the content of the prograiji in action. 
These include thc'vague terms^uWed to def.ine educational activities , the 
mixture of programs, that .were funded, and the lack of cotre^pondenc© . 
between different accounts of how. the money was used. The most important 
conclusion, h6wever, is that if is not possible to define a distinctive 
program in ac'txcin. The activities that ES^ 'funded look much like the 
Ijinds of things that go orf in the control schools. Though it would b'e ' 
possible, 'in principle to differentiate experimeptal^ and control schools 
in terms of the extent or si7.e Qf the- funding, data were not available 
for this purpose.- Because of this., the remainder, of thq analysis is a ■ 
general investigation 6$ relationships between, educational programs and 
Student outcomes; this invotstigation .cannot be tied to ESAP per se.- 

(A) ,Can teacher and student noncognitive variables be related to 
, particular educational programs? . ^ ,^ ' 

^'P?ogram,s and ''activities are identified in Section ^VT,.^d these. 
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of attitude and* behavior for. 
Generally, s'i>eciflc programs 
ef.fect on teachers or student 
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dimensions of the schdof envijonment are related to selected m^asu/es 



teachers and students in Section Vl. 
:o not have a substantial or corisisixdnt 
j, but there arje two important exceptions, 



Both teachers and -stud^ents te ld to have more positive or &avofabl|>'^ 

attitudes and self-reported bi^fiavior nhen their schoolS have one jof . 

two kinds 'of programs: Lnservkce training that emphasizes race t|ela- 

* , 11 • , < . * *•* 

tions,*or prgej^ams In intergrdiip retations for students. ■ Jhe effects 

are mbinly concentrated ai^ong White students, howeyer.^ Thus^ pup of 

the main* objectives of .ESAP, /tile improvement of race tfelatiqns ii 

4SchooVs, .1^ attained to a ^reaiW extent in s?c)ioo1s that riin the k'inds 
of programs that might l^3^pedted to achieve those ends. The ^ize of 
th(?se effects should noVbe exaggerated, but^^e clues afforded by 

* these rtisul'ts dre-encoutagmg./ 

(5) , Can educational ^chie^ment leveAs be linked to nonco^ni tive- 
variablesf, and these in turn to educational programs? . , . 

* o , W • , I * 

If certain educational pragihms can be associated with dif^ereAces 
In student atti't'udes, can both'b^Uinked to educational achievement? * 
^Tho question is whether the (JegrcU to which achievement is relalted to 
these* no-ncc^ ait ive characjterist icij of students can be attributed to • 
the presence of program^5 .i-nvoly Indl intergroup relations. Therd appears 
to-be no connec tiQn\ of this kind, fior althoughyachlevei^cl^t levels are • 
associated with noncogl[iitive dif fa:|orice's among students, the existence 

tributed to' particular educational 
tion-also contains an analysis of 
erimental school .scored muci, higher 
1 school. This'^'Shows the "Successful 



of those relationships Qannot be a 
Strategies (Section VII). "This se 
dist-ficts where students in the ex 
(or lower) than those in the con t if 
ESAP schools tended to be smaller 

• • m 

The way ESAP was implemented m t*\ 
diffi^rence. ♦ 



and situated in fairly i^ural 
district could account for 



areas .. 
this 
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I.. INTRODUCTION . ♦ 
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The Emergency School Assistanfce Program (ESAP) provided financial 

• • • r > *^ * 

aid to-^schooliS thalj w^re in the process of becoming racially desegregated 
or hdd recently made this transition. ' The; program's objective^ were , 
broad one^: • * , * 

Tha purpose of* the emergency asfidstance to be' made \ 
.available^. is ' to meet special, needs incident to the eHmlna- 
tion^of racialj segregatioji and discrimination among 'sCuclents 
and faculty in elementary and secondairy schools by *cOntrib-t • 
utdng to[ the cjSsts 'bf new ,or ^expanded^a^tivitiies . . . designe^ . 
to achieve successTul desegregation aAd*^the elimination of 
* . all forms of discrimination in the schools, on the basis of 
>* race\ color/, relLgijDn or national origin. (Pa^t 181.2, * •* ' 

Jiblfe 45, Code of federal Regulatloi\p. ) ^ ' * * / 

This was tbj be. achieved by financial assistance > which, for the schools 

^s^fcudied here,^'amount;isd' to about $10,000 per school. The .funds wfere 

used for all kinds gf things, in keeping with- the 'broad^ rar^^e of activ- 

iti.es ^utliorized by the bill: teacj;ier ^traihing, remedial education,, 

. curricuiar innbyations, pOrchase*of teaci\fag equip.ment, cofnmunity pro- ^ 

grams, reraodelj^ng buildings, anM hiring professionals such as guidance 

counselors or ti^Bch^r aides. The impression is that 'the program^s aims 

JLapked specif iqlJ^ty and the means of attaining them were correspondingly 

difftise. But though, the program had a §bod deal of fl^ibility in * 
^ ' . • ' - » ' / ^ . ' 

^ action^ legi6la'^kt)rs perceived a specific, short-term ne^d faced by de- 

segregating Schools, as evidenced -by Congressioha l Jp arings . Furtds 

were to help wi«h a temporary/dif ficulty . . * , , 

* ^To what extemt was this notion of a d^isturb^nte or crisis justified? 

Pr^limiryary to ,the ma:^n analyses reported^ here, the data collected for 

fixe evaluation. o£ ESAP wer^ used to see if schools did experience 4 

short-term crisis associated with .desegregation/ The'anaiysis, reported 

at the end of this Introduction, deals with the. way teachers and students' 

• perceive the quality of race relations in the schools There is a small 

.V . * . ■ " ' " * ' . 

but discern-ible^ tendency for the quality of the social environment to 
decline and then recdVcr as a ^schoot makes ,th*e -transition to desegrega- 
tion.^ But i^t alsQ s^iems the onset of<»this disturbance is delayed. 
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8ugg6sti,rtg that sqt>ools take tije 'to catcli up to J:he problems associated, 
with changes in t^ac'iir cqinRosition. ' This ^alysis; theb, gives ,quali.fied 
support for tHe coiiimori Wrtse notion tt\at."schi^oltf experience tempofary 
disturbance. /InyetrosiTect-^he assumption "of ESAP,>hat schools-^wete, in 
fact, disrupted^by desegregation ^s modestly supported by these datai, 

A ASjbr ifives^i'g'aEion of the* program/s effects was mounted by the ^ ' 
*Natior>al Oginirfn Research Corporation (NORC, Vol§. 1 & ?, 1^3), and the 
data coUecxed. in that evaluation' are the fcasic materftl fo^this- report. 
TlKi eva^^ation. sought to ext>lain how ESAP money had beeB^'f>ent ._:afld what •* 
effect it had had" on' schools, teachers, and studgntsr. The ^ost important 
f*inding'was that students in E9AP- funded, schools scored higher on an-. .^^ 
achievement test, than similar students in comparisoa schools, j The P«>--. 
gram had an e.ffect'qn educational performance. However,, thi-3 ef'fect was* 
Jound for one group of students on ly,^ blacL-male lOln graders. It-dijl _ 
not have the same effect on black females or whites either sex, nOr . 
dxd it hav^ thi^ 'effect on the sample^ of. .5th grade'r-s. . ^ , • 

The iNa*tion^l "Advisory^ Counfcil on Equality of Educational OppO'rtu«ity 
' (NACElEO)' askedj^the Office-of Education to p»iTsue this f.inding further, 
and the -contract .for^this Work was awarded to Rand. The ' Advisory Council 
'intferesV in Che reanalys'is was promptea by the^'need for information t^at 
miiht help guide ^SAA, 'the' successor to ESAP, which it was the Council's 
task to monitor'. The CounciUdid not expect definitive answers.- For one 
■-'thing, the pr.ogram effect was 'fairly small, so any' associated relation-^" 
sLhips were likely to be weak. For another, there were assorted problems 
/of measurement that imposed limits -any analysis, notably th^t seeking 

to .identify the content o^^the Emergency School Assistance Pr^ogram.- 
' .Therefoi-e thl secondary anal>^e? are-'cai^xled qut as, a £ree-ranging *and 

opeftTe\ided. inqiTiry; the aim tq search for any useful informatfon about 
/the way E?SAP worked, and those par.^iiularly how i,t succeed°ed. It is an, 

exploratory, not a conf tribatoijy, inquiry..' 
/ ^ Rand's secondary analysis had .two parts. The first was a reinves- 
tig4:iop of the* program' effect £>n the achievement scoj^es. of black male 
lOth "grade students'. ' The fesultS ^. th^s^ stagq of the wor}c show that 
these students did. score above similar stu'dents in comparison schools, ^ 
• though the new estimates are somewhat smaller than those reported in the^ 



original evaluation. It appears black male students in the ESAP-fiinded 
scKooLs scare, on average, one test point above those in the comparison, , 
schools. The 'second stage of the Rand work, reported ^here, sought to ^ 
account for the special* program effect on this* subset of students., «The 
original dataware reanaly^sed here with the aim of finding, out why the 
Program wa# associated with better ed\!ldsrttional performance for one gr^up 
of students, 'but not *for others* " . . 

The first part^of the analysis (Sections, II and ^III) pursufes a pes- ' 
sibility raised in .the crriginal evaluation that ESAP altered the racial. 
climate\of the schools, ^nd this in turn helped some students perform 
bettioV on the achievement test. Racial climate is measured, in a .number 
of ways, including statement's of attitude on the part of teachers, 
students, and |fechoel principals; their self-reportfed behavigr*, perceptions 
of others, and observations about the qualitjr of race relations. These 
are used tp investigate two propositions: (1) that ESAP schools had more 
-favor^able. racial climates, and (2)\that that Climate had a specialized - 
effecft on some subgroups' of studentsy and n^t others in^ the way they felt 
abpuf school and how they got on there^* 

ThisSs followed by examination* oX the ^relationship between student 
achievement levels and their c^ttituSes, self-concept, perceptions of their 
teathers, and other measures .that^ are callecJ "fioncognitive." The purpose 
is to' search for differential relationships for the four '/Sie and sex 
groups tQ ^ee if achievement is influenced by these- noncognitive variables 
in ways that could. explain the* performance of black male students * 
(Section IV) . o 
The next step was to make a more detailed analysis of the program 
in action. ESAP money- was used in all kinds of ways; because ^of this it 
is^natifir^l to, ask if ^some'Oses, activities, or, programs were more effec- 
tive than othe>rs. Accordingly, ih Section V, I' look at the different 
uses ma^e of ESAP money and discuss the difficulties^ of identifying the . 
schaol-level activities with certainty. Then, '^in Sections-VI and VII^ I 
investigate the effects of 'different program types on a range .qf outcome^, 
including teachers' Attitudes toward desegregation ahd: toward minority 
students and students' feelings about school ahci their educational ^ 
perfofmancel ' . ^ , ' 



THE DATA SET ' ' * • * . 

. -i In '1971,^r97'2\ the year of 'the evaluation, the prograjn ,invoJ.ved 
452 school districts and varying? numberrs of schools within. each, of these 
di*sj:ticts.^ii. This secondary* analysl-s-is concerned with a subset of school 
districts in j^hich* ESAP was administered on a ranctomized basis.* There were 
JL03 districts, included in this^art of the program; 48 of them had a pair 
j^^high>schools. In each of these 48 districts /school administrators 
selected a^pai^i^of higlv-schools that h'^d, comparable populations of. stu- 
dents. rOne 'fechooi\£rom each pair was then jrandoiiily chosen to receive ES^P 
funding," and the unfunded .school became the control for comparison purpojses. 
*Much.of'\^the"secc|ndary analysis involves comparisons ^betw^^n the experimental 

x>s tre^tWnt, schools and the control schools, \ 

^ Thfe-^8 school-pairs studied here are the total *set of ekoerimfental and 
control schools, a' sqhool-pair was eliminated from the previous anajc^sis* 
either because of conventional missing .data problems "or; because there wer^ 
no students *of a giv^n race or sej. • ^* 

^ THE cI^gtEM£NTATION ^F. ESAP / 5 

A potential- problem .involving the experimental deSign is thar it does 
n^.L "^appear to have been perfectly executed. 'Some experimental schools 
did not receive ,the ..treatrfient while some 'control schools did receive it\.3 / 
Information was obtained from .the ESAF direcW,. who was^ responsible\f»<}g^^i?i,^' 
feSAR at the- local -level and reported on the use of^ESfE funds In each 
schd^l^ He was also a^ke^d whether the schools had received these funds' 

I in the. first place.. Two of the 43 experimental schools were found not to 

V* ha v^ •Obtained the program money,. «or did they have any ESAP-funded activity 
^ •*"»*••"'' 
such as inservice training or new .personnel,- equipment, or resources. 

* - . ' > - • ' ^ . 

\ Fo/thG control schools, seven of^ tHe 48, were reporte.d to have re- - 
i J , I ' ^ , . * ^ 

ceived'^ES^P mjney, and* in six of these sfcven the ESAP director also re- 

m>rted*a^ least one activity or prQgram financed by ESAP.^ This breakdown 

is reported, for control" schools only, on the .following page'. • 

f ' *To take* the 4iiost stringent view, 19 control .schools^had some ESAP- 
fiincfed activity. Since one or. these is the school matched to one of the 
two experimental schools" that violated the experimental design, thexe are 

'^20 scho9l-pairs out of 48 that do not'comply with the 'experiment protocoT. 



TALLY OF ESAP-FUNDED PROGRAMS, , 
• " ' ' (control schools only) 



ESAP« Funding 


None 


At Least One 


Total 


4 

. None recorded 


• 

28 * ' 


13 


41 


Some fundi^ng . 


1 


6 


7 


Total 


29 


19 


48* 



• • ^ — ■■ — *n ■ 

♦ 

A case can be mad€ that these data are ambiguous. First, it is - 
possible there was. some confusion about which schools vera. being asl^d 
about by the interviewer. This is likely because a golod deal of jschool 
information was obtained by leaving questionnaire forms for later com- 
pletion, often by ''the director's assistant." Second, spme ESAP-funded , 
activities were available on. a district-wide basis. For example, "an ' 
inservice training scheme run from a central location would .draw 
teachers from a number of different schools ^ perhaps including the 
control schools. This would explain the 13 control schools that did 
not receive ESAP funding', yet participated in ESAP— funded activities. 
To check, this possibility I looked to s^e if the programs recorded for - 
thesfe 13 school*? vfere' the kinds" that might logically be offered on a 
district-wide basis. For instance, did these schools**- tend to have pro- 
grams like inservice training or" co'mnvunity projects? Or were they just 
as likely to have purchased audio-visual equipment o^r to have installed 
tutoring programs, the kinds of things that are more logically delivered 
at the school level? There is a problem of making a neat"* distinction 
betweeti district^- level and school- level activities, but to some extent 
this can be ^one, and subsequent analysis showed no tendency for the 
13 control' schools to have taken part in the firsf: rather than the second 
kind of-progt-am. ^ - 

Inoview of the im^portance of the experimental design and the possibl 
violarion of that design, key analyses' that will be reported here were 
replicated eliminating the 20 school pairs where the experimental design 

may have been mismanaged. The results of these analyses indicated thlere 

* .»•'■' 
was no bias involved in including all the schools, so analyses reported 

if 

here' are based -on the maximum data set of 48 school-pairs. The decision 



to use ,all possible schools was .based on both the epipirical finding 
that the schools violating the design do not bias the resolts and 'on/ 
•the uncertainty**about the quality of the information reported by the 
ESAP director. * ' . ' 

I 

. INTEGRATION AND DISTURgANC£ . * 

* It was suggested earlier that integration , goes with a period of 
temporary disturbance in the schools.. Af- comparison of schools that ' 
had been integrated for dif ferent' lengths of time made it -possible to 
test \^±s supposition. The^ principals in experimental and control 
schools were asked when desegregation had* had th^ "jreatest effect on 
change of racial composition of the student body." Schools where this ' 
change had-'.'.Si;^,!^- greatest in the current school year (1971-:1972) were * 
separated tho^ where it had taken place in the two previous years " 
(]^9-19'70^4i'^^(1970-1971) and these from schools .where desegregation 
had-^aken ptice^ earlier yet, making thtee levels of "recency of^^deseg-^ 
rogation. " Two possibilities were investigated^ First, it might be 
that most recently desegrega^'fed schools would be worst off, followed 
by .schools desegregated^ next longest, followed by the schools deseg^ 
regated for the longest period. This is ba9ed>on the" idea of a«^steady^ 
reVovory from the immediate efiect of racial mixing. The second possi- 
bMity is a little more complicated, involving the. notion a delayed \ 

-reaction. Her-e, the effect of desegregation takes a. year or \so to be- 
come evjident, followed 'by recove^ry.. If Xhis is how things work, schools 
desegregated for one to »two years should be worst/of f and schools that 
have been desegregated for shorter' or longer periods would be relatively 
bqtter of?. The two possibilities can be diagrammed ^^s shown at the top 
of- p. f7. c ' , 

Measures of, t\\e school environment are derived from principal; 
teacher, and student questionnaires and cover, among other things., their 
perception of the relations between racra, pf teachers' at titudes -^o' 
desegregation, students' attit-udes to^their schoolworlj, and studfents' 
attitudes toward students of the opposite race* A total of 67 Iheasures 
were us,ed. Simple comparisons were made among the schools desegregated 
for different lengths of time; these cgmparisons showed very few 



Variable Indicating 
Quality of School 
' Environment / 



* First 
Hypothesis 



Favoi;#ble 

score 



•Unfavorable 
scope 

Year school 
desegregated 



. 19-71 1969/ 1968 or 
1970 -before 



S^copd 
Hypdthesis 



x 



X 



|». 1971 1969/ 1968 or 
1970 before 



. . : . ■ ( ■ ■ 

statistically significant results, but the trend of the mean scores ^ 
for schools is consistent with the second hypothesis about the effect ^ 
of desegregation. Schools appear to experience a Tdelayed" onset of 
the effects ot des*egregation, which became evident after one or two 
years, ^followed by recovery. To- repeat,* few of these differences were 
found to be' statistically significant; the justij.ication'^f or the con- 
clusion is based on the similarity of results for ^ substantial number 
of .variables,, not on the size of the differences involved. - Therefore, 
the- results of the analysis are not reported, except that descViptions- 
of variables copforming to^ the second pattern are listed* in Table 1, 
which also shows' the total number of variables^tfsed in. ttie analyses. 

Although the results are n€>t strong, they are consequential be- 
cause they confirm the common sense observation of the association 
between integr,ition and disturbance, io it is important to test alter- 
native explanations, of the findings. One contending^ explanation is,^ 
that desegregation had taken place earlier in rural ^reas, 'and urban 
districts follQwed later. Schools desegregate^! the longest were there- ^ 
fore wore ^lilcely 'to ^e rural and to experience .fewjer tensions and diffi- 
culties as a result of .their rurality rather than because, of the onset 
of desegregation. Conversely, .schools that had beert desegregate^-^ 
short time Were more likely to be urban schools so that the measures 
of the school environment would be picking up the influence of the urban 

16 



environment. Therefore the analyses w'i^re repeated conti?olllng for the 
perc'ent of the population in the county lirving in communities over 
2,5(!jO» The introduction of this control did not alter the original 
conclusion; the pattern of -results coul4 not be explairied in terms of 
the"" different locations o^. s,chools- ^ 

Table. 1 

SUMMARY OF ANALYSES RELATING THE LENGTH OF, TIME 'A SCHOOL HAS 
BEEN DESEGREGATED TO THE RACIAL CLIMATE OF THE SCHOOL 



Teacher" data (24 variables used) ' ' [ \ 

RepQ.rts a greater amount of f ighting*.than before desegregation 

9 ^ ' ' 

"Reports white students becoming less prejudiced 
Describes contact 'between whites and blacks as ^friend;iy 
Thinks blacks wuld be better ^ off in integrated schools, n'ot segre- 
gated ones . , * X - * . * * 
Thinks whites would be better off in integrated schbols-r-not segre- 
gated ohes * ' . 
Feels it is proper to l^t students know how t^iey f'^el about race" 
relations ^ 

Tends to have class discussions about ^ace 

. - ' ' ' • 

Says teachers tend to Ije fair to black, students . , 

' Reports students/ t&nd to be favorable to desegregation- • ' * 

Reports white teachers in school tend to. be favorable to desegregation ^ 
Reports black teachers^ in school tend to be favorable to ^desegregation- ^ 
Thinks the civil rights movement has" done good irather than harm ; * ^ 

. Thitaks' that blacks and whites shouid be allowed * to intermarry 

Says .that ?tud^ent dances ha>te not been eliminated because of possible 
racial problems. ^ ' * ■ 

Says that student elections have not .been elimiaated' because o^ possible 
racial nrob-lems , > , * ' , 



Principal data (-17 variables compared) , 

Thinks that whites would be better off Integrated, not segregated 
schools 

Thinks the civil rights^ movement .has done more good tHan harm 
Reports black teachers' attitudes to desegregation being favorable in 
' his school . - - ^ - 1 — • 



Table 1 — continued « 



'StudenV data (26 variables compared) " ' ^ 

Says he feej^a he b'eJjDngs ia the school . ^ ' ^ 

^ ■- * * ' 

Says most of his teachers like the idea' of blacks and whites going to 

the same school ^ 

Tends to disagree that "white .'students complaineji favoritism, is being 
shown Co^blacH students*^ - ♦ ^ 

Tends to disagree that "tensions have made it hard for everyone" * 

Reports* few serious problems in the way things are working out be- 
tween black and vThite students in the school' , 

Says that among the thrte students he talks to most in school^ at , 
ieast one is of the opposite race^- 

Had called a student 'of the opposite race on, the «phone ' \^ 

Had helped a student of the opposite race with homework \' 

Had agked a student of the* opposite race for help with own homework* 

Would Dre*feT to be in a racial-^'lnixed' School * ^ ' 

Would like to have more friends* of <the\,opposite race ^ . * ^ 



Says he is usually . comfartable "around- st^idenfes of th^:- oppo^^ite rakie^ 

Disagr^ees that studeats of ^e oppt^ite xac^ are dumb 

Thinks that race ii^ riot linked to smartness r 

Reports that he. tends to be^happy, "thebe 'days ' ' ^ - 
f j I 



Note: '^Schools were, ^iivided into those i where - the effect of desegrega- 
* < tion was reported greatest durir^g the present academic year 

(1971), during the two yeai^fe previous to that (1970^1969) and 
■earlier, '(1968 or. before).^ Mean l^cares on measures of schopl 
clftnate were (jompute'd for each o\ these three groups. The^ 
tot^l number of variables analyzed is shown at the top of 
each section. The body of the ta.ble contains ^descriptions 
pf the variables, that show the scbre for "the second group 
; (desegregated 1970,^1969) indicates the School to have. a less 
favorable racial climate thaij either *the first group (desegre- 
gated during the sdhool year 197^1*)'^ or the third ^roup (desegro 
' gated; before 1969). \ c ^ 
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II. 4)1-6 ESAP ALTER THE RACIAL CLIMATE OF THE SCHOOi:?-^ V 



ESAP was intended to assist schools in the process of integration. 
Integration involves more than racial mixing; it also refer^s to ^the 
qyairty the relationships between racial groups, the degree of har- 
mony in the school, the level of hostility, students' attitudes 'toward 

onenanother, and -the expectation* they have of themselves and of the 

« • , ... 

other group. These intahg^ible qualities are sometimes talked about 

collectively as the !*racial climate" of^ the school. Since ESAP was 

expected to help schools integrate, it is reasonable to- ask if it had 

an effect on climate; did schoo-ls that received program f undlug^have 

more favorable environments than the unfunded control scjyols? ^ 

The second reason for raising this question was suggested by the 

authors of the original evaluation. Their summary contains the specu- ^ 

lation that black male 10th graders scored higher in the experimental 

schools "because of improvements in the schools' radial climate affecting 

the motivation of these students"- (NORC^ 1973, p. iv) . As the report / 

^ made clear, the evidence for, this /suggestion was incomplete; in fact, the 

analysis of ESAP's influence' on student attitudes toward ' integration 

showed no effect of the kind they suggested. But only one measure wasT 

used (NORC, pp. 55-58). Much the greater .part of the datd on student, 

teacher, and principal attitudes ah^ behavior was not used to answer the 

question: Are there any differences between experimental and contral ' 

schools that could establish the link between th4 program funSin^Jand 

thejiigher performance of black males? . ^- 

In this section, I make straightf orward unadjusted' comparisons be- 
V. tween ESAP and control- schools. Since the purpose is-to look at overall 
program effect, tbe stydents are not divided here by race and sex. . The ^ 
most, important data are obtained from prilJPipal, teacher, and student 
surveys. 'This information is supplemented by data obtained from th^^,^;'^ 
- school counselor and from an observer (the person from the evaluation{ ^ 
team who administered, the school surveys). ^ ( 

An interview wns administered personally to each princijSal in eadh 

- experimental and control school.' Since there are 48 experimental and 

■ ♦ 

^ - --1-9-- ■ ■ ' — 



48. control schools, the results of this survey are preserited^,_as„/^njjiber 

• <■ « . 

of principals 'responding." ♦ * ^ . 

Ten lOth-grade teachers were sampled from each school and given a 
questionnaire^to answer on their own. Since jrliere are unequal numbers 

^.o( teachers in experimental (495) and control (4-89) schools, comparison^ 

" ' ' ' " II ' ^ ' 

)of these data are presented as perce-tages- (for example, x percent of 

Experimental school teachers said..."). . 

Student questionnaires were given out in class by the"* evaluatibji 

staff, and ^ev6ry effort was made to have students complete it when the 

•teacher was out of the room becaTuse some questions deal jijith students' 

perceptions of their teachersN Here too, there are slightly different 
♦ * * ** 

numbers of studeats (2665 experimental, 2621 control) so results are 
presented as percentages.,, r • ' 

Data from diach source are classified Into four broad areas: jrela- 
tions between different groups with an--empha2is on their behaviqr, 
attitudes of ,the principal to integratica and to minority groups, atti'j 
tudes of the^teacheirs to integration and toward minorities; and attitudes 
of^>tudents to" one another" and their feelings about themselves- 

- ■ ^'^"^-^-^ \ " * . ^ 

RELATIONS BETWEEN .GROtffxSu 



Possibly the simplest vay bf-as^sessing the <}uality of relations 
between groups is to ask an outsider f or^his^T:inm9^^ Such* 
--an-outs4der -4,s~.the^ejinb„ejL^^ visft^ff^'The^chool ^ 

Ito administer vairious questionnaires. While thet^, he recorded his 
sens^'of the'"general atmosphere." Most schools, of both kij:ids were 
found t'o be- orfefexed rather than tense (30 experimental and ^31^ control) ; 
there is no imp'd'rtant -difference between t^e experimental and control 
schools! This'a^sessm^nt is backed up by the teacljers who usually 
indicated that prjoblems ^associated with desegregation were "minor" ^ 
(80.9 percent experimental and 74.«'percent cpntro'l),. However , ^ students 
offer a different account; they were much more likely to say tensions 
had5"made it hard for jyeryone" (47.7 percent ^of studei^s^ in the.^xperi- • 
mental schools answered this way and 48.6 'percent of the students tji 
cpntrcJl schools). The difference between students' and teachers' re- 
ports may well have to do with the wording pf the ques'tioils — tensions 



are no't the same as problems— but stiLl, there' is a good chance different 
■groups* perceive the same situation iir different ways. 

General qu.estions have the disadvantage" that people 6an read their 
* ' - ^. ^ * ' ^ • 

own meanings into^.them* This is harder when questions are specific. 

For example, the principals were aSked how mbny da.ys the school was 
closed-durlng the year.becausfe of racial tensian. Only <wo ^principals . 
(both of experimental- schools) said this had happened. Asked about the 
previous year, rather more said the^school'-had closed (3 experimental 
•and ]0 control). The difference between experimental and control schools- 
"here «annor be attributed to' the^recency of desegregation;^ the experi- 
mental schools tend to have been desegregated i«nger,,^but not by much.- 
" TeaChorsi wer-e also asked about the suspension of normal school activities 
because of racial problems. They' reported on the elimination of dances 
(3A.5 percent experimental pnd 31.4 control)' and of student elections 
(7.. 7 percent^'experimentai and .6.4 percent eontrot)'-.. More drama'tic was 
•information about whethei teachers were attacked by students (2 experi- 
mental sct>o6l.<< and 5 control) , and' about the amoupt of fighting that 
-vent on among students /in 13 experimental and . i2 coptrol schools, fights 
.«vj.e4 to ,6he -need for medical treatment). The>level 6f overt hostility' 
. "seems just about equal in both types of schofils;' this is supported by 
Xhe students' own account, which may'.bring out (or possibly exag^gerate) 

■ details thata(ilults would rath'er -forget <16;; 7 pefcent^f students said 
_they had- been involved in a fight during the „jEear in -experimental school^ 

and 15.7 percent in controls). Students also reported quite a lot o'f . 
Interracial fighting, though they ten4 to report this from the point yf ^ 
view of their own "side." In esetJerimental soboois, .36.7^ percent of the 
students said blacks" had attacked whites/ and ^^in control schools,. 

~16.7 percent ,saLd tlie sama. 't;^^' I ""'i' 

Harder to'interpret than the levels "o'f -violence in the school are 
the stati-stics on discipline and control. Yet this is an important area 

lich the .relationship between /aciults -and students' is expressed and 
indlreHly tells,us about the level of tension in the "school. Expulsion 

■ is the mosK serious action schools take, to deal with student prohUm^,. 
Lit is not us^K?ften; in fact, It was' used si) little in these ^schools 
■ that it is a poorXnde^ for the purpose of this Analysis. (Of 10th grade 



students in expepimentstl schools 1 percent had been expelled that year 
and 0»4 percent in controls— fblack students only) ; Dr'opout'' tates , which 
may reflect an- ijiformal>xpulslon, are also very similar for the- two 
kinds pf. schoftl (6.3 percent of 10th graders dropped out of experiine,ntal 
schools' and 7. "2 percent in^controls) . Ahsienteeism is'another creclible 
measure of the degrep to which students find school an eqjoyable or , 
rewarding experience ^ and here, too, experimental and control sch(3ols 
lode almost identical "(two experimental ^school principals And three qonr 
trol said absenteeism »had increased for black* students during the previous 
year). The students' ewn report supplies the same message. * In experi- 
mental schools, 54.6 percent ^aid' they had "strayed away from school just- 
because they didn't 'want to come," and ,54.3 percent in control schools. 
*THiey were alsa similar when it comes to being sent to the school office 
for breaking. rules (46.1 percent of students in experimental schools had 
been at least once" during the yiiar and 47.9 percent^in control schools). 

Finally, there are various hints about, the jexte.->t to which black 
and white studerjts mix and form friendships. Generally, students ^eep 
themselves apart.. Most often they said'the three people they -talked to 
*most in school were of *the same race as^ themselves (78.4" percent in ex- ^ 
perimental schools and '80.4. percent in Controls) , and they were unlikely 
to have made sociar contact outside^chool (25.8 percent in experimental 
schools had phoned a student of the /'other race and«28.3 percent in con- 
trol schools). However, the informal segregation was far from complete^. 
About one third of students^ said they had asked, ior help with homework 
from spqjeone of. -the other race (34. 5 percent experimervt&l and 32.2 percent 
control). Teachers suppo.rt this account; asked»to characterize the 
quality' of contact between .blacks and whites* they>ost usually said there 
were a "few" interracial friendships (52.6 percent of experimental school 
teachers and 46.3 percent control). Added to that, tJ^ outside *qbrseryex 
usually said he h|id seen some interracial groups around the school during 
rece&s or after school (23 of the experimental schools and\22 of ^the con- 
trols) . The most important point in aK^his is not Xhe level of -inter- 
' action byt the difference between experimental aqS control schools. 
While some cwnparisons show''\students in experimental schools are better 
off than those in controls (11 out of 21 comparisons favor experimental 



schools), it Is- also true that control >school students are bettet.off, 
than experimental school students in soueral other comparisons (10 out 

of 23). ' ' . . . ' i ' * 

The only tenable summary of balanced results .like these ±s thafc^ 
the quality of relations is ^^stematically ♦neither better aor worse, 'in 
the experimental schools. In no single comparison is there a dramatic 
diff.erence between the two-kinds gf schools. Yet if ESAF did not chmige 
the quality of .relations , perhaps it altered the way. principals anfl ^ 
tethers felt c^bout 't?(ie Issues of race and Integration. , ^ 



THE PRI NCIPALS' ATTITUDES • > . ? * ^ 

_ ^ ' . ^ " 

The principal, is- in a unique position to def-ine-what—ecmstltutes 

.accteptabie behavior and to' change peopile's ideas and atCitudes.^ This 
J " • ^ 

is not'to^y he does exert such powerful/influence*, but .he might*. { 

t - , ^ * / y * *jC 

Therefore his attitudes toward desegregation anrf minority group ^tudentTfe 

are important. One indicator of his enthusiasm for desegregation was 

obtained directly by asking how" well he llked^ it; most sajd they did 

(33 of Che experimentcil school principals *d 38 of the control^). ■ 

» " * * * ^ - ' . " <»- 

But it seems* this feeling is not perceived by others-, since only about 

a* third of the teachers said they thought the. prtncipaL liked desegre^a- 
'* . * * / " ' "* * ' 

tion O'iA percent exporimefipal^and 31.6 percent controls); students 

were even moxe doubtful (16.5 percent said their' principa^l likfed it i^ 

'oKderimental schools and'. 16.6 perc^ient in dfentrol schools). Some of the 
^ , * • , ' * ' / ^ <i 

difference is probably attributabl3^ «to the way the questionnaires were 

'JX4Ued iw. Principa-ls^'did it face-to-face with an interviewer who was 
'identified as an ESAP evaluato^j teachers and studen(;s filled theirs m 
anonyn[iously so they may have been more 'candid. • ^* 

Principals were'al'so asked whether students would be, better off in 
schools' that were racialky segregated. . Th^is^t-reveals equally .positive 
inclinations; four of the principals of experimental schoqls said blacks 

-would be bettor off and' five of the control school principals. Not sur- 
prisingly, they an'Swer differently when askecf about* whites; but still, ^ 
less than half say white students wou-id be better off IrvSegregated 
schools. (14 for experime^ital 'schdol princtp?Ms and 15 f.or controls). 
Again, ^the res^^lt^- are* mixed 'and' do not support the cort^^ntion that 
there were cl<^ar differences between experimental and control schools. 



THE TEACHERS' ATTITUDES . — . . ' . 

'Principals of the two classes of schools are evidently quite alike. 
But perhaps they are figureheads, without direct Influence on the day- - 
\^to-day life of the students. It is , much harder* to argue that the class-/ 
' foom' teachers are similarly remote,, so their attitudes may 'be even more 
significant.* However, the teachers in experimental and control/schools, 
like the principals, appear to be much alike. For instai^ie^ asked w^e^ther 
blacks would be better o£f^in all'black schools, 29.7 percent of experi- 
mental teachers ^felt they would, and 25^8 percent of control school 
teachers, .which suggests control school teachers are^ soiqpwhat better 
disposed to Integration than experimental" school teachers. Asked the 
same question about whites, the differejhce, is reversed (41.5 percent of 
experimental School Jte^icherfe say whiteS wpuld'bfeT better off and 41.4 per-^ 
cent o^.^x:ontrol school teachers). Other gropp^s also reporte^ on wha't - ^ 
they fe]^ teachers' attitudes to be.- 'For instance, principals tended to 
say theiv teachers liked desegregation t2'8 of experimental school prin- 
cipals- %aid white teacher^s liked it and 32 of the control school princi- 
pals said the «ame) . 'the students wer^ less likely to think th6ir 
teachers liked desegregation (10.4 ^)ercent ,df experimental school stu^entg 
said so and 9.8*percent of the cVntrol scIk)o1 students). , • 1, ' ' 

■ Teachers were as^ked about black' stukente*' aca4emic potential, some- 
thing to which great imp'ortance has^Jseen attached by the research commun- 
ity. They were asked to judge what proportion bf blacks had the potential 
to attend the largest university in their state. .Very f ew ^safd that even 
half thfe black students In'their school had^this future (7.0;,percent ^ 
experimerital school teachers and 6.3 percent in control schools). Teacher 
were also asked to assess the-propbirtiont of li^cks who were "discipline ; 
problems," and here too there is litti^ difference between experimental 
and control schools; ' about half the teach^r^^ in ^toth types of schools 
said at least one in 20 of their black .students Were ddsclpldne probletrts 
(53.4 percen? experimental and '55.1 percent control). 

Again, although th^te are individual, comparisons that show the' 
teachers in the two kinds of schools we^re different from one another,, 
the differences tend to cancel out. Taken, together there is Itftle 
indication that teachers ia ESAP-funded. schools had more, or^ les^ 



favorable attitudes* toward integration, or.. to their students^han 
teachers in contror schools. * 




StUDEJ^TS' ATTITUDES • . » 

..'The students. were ngt asked about desegregation directly ; .instead • 

they.were asked whether tlTey woUl^ Tjrefer to attend a racially mixed - » 

school. In experimental schools, 49.8 petcent said they would and i;n^ 

control schools, 47.6 percent: rather less. Cbmparable differences 

shejw up on other variables -too.* For example, asked if they would lik^e ^ 

more friends .of the o.ther race, 58.3 percent of the experimental school 

/Students said yes and 55,6^ percent of- the conttol school students. 

.Very sjigh.tly fewer students in experimental schools say they are never 

^uncomfor table around students of the opposite race (32. percent and ^ 

32.7 percent). However, they are just about equaUyhen It came to 

saying if students of the other race are^ dumb (29.4 percent and 29.2 ••per'-* 
n . * ^ . . . ♦ • ' 

cent) ^nd. if. -race has anytl\i*ng tq do with smaxtness . (81.6-perceat in 

experimental schools said it does not and 81.6 percent in control schools) 

A di'f ferent angle on. thff qualltjy o^ the school* atmosph^vef can be. 
obtained from sjtudents' -^^answers to questions about hiow much they like 
school ^.id how they- f efel they are treated there- This bring^ the dis- 
.cussi^)n back to where it began. One index of. student perceptiort is the 
*vlew they have about the fairness of the rules in the .school.- ' Only half 
felt the ruTes were fair 053.6 percent irf experimental schools and 
52.2 percent in controls), and a- lot thought they got pun^.^hed fot no 
good reason 'C44.1 percent and 45.6 percent) . "More, generally, the lOth 
graders w.ere not especially enthusiastic ahout goings Co school (43.6 pet- 
cent said they were: pleased to go to school in the ejcpferimental* -schools 
,and 44.6 percent in Controls). And whefi-.they got there, only a few felt 
jthey" belonged in the- school in. some way (21.5 percent and '24.? percent). 
Most of these differences favor tne experimental .sthools and indicate 
.^the program 'improved, things for js»tudents. Students i^^i experimental 
schools were alsb^tnore optimistic aboqj: thinking, they could complete^ 
college (.65.9 percent and 64.8 percent)., although they ranked themselves, 
in comparison with their classmates^ in exactly the same manner (28*1 \)er- 
cent say they arat above average in experimental schoo^^ and 28.1 percent 
incontjols) J $ . ^ ^ # 



In conclusion- the best evidente that ESAP made schools more^ 
' harmonious places comes from the analysis of 'student attttude variables. 
.'••Students in the experimental schools were slightly more likely to pre- ' 
*fer desegregated schools » to prefer mpre friends of the other ratbe, ahd 
(l comfortable around students of the other race. But^evfen^ here 



^*^ere is contradictory evidence, showiijg control school 'Students were.* 
•happier about going to school, for example. In the other three areas * 
.•explored here, experimental and. control schools seem very much alijke. 
Ta the extent that comparisons -from different sources. can be fitted td^ 
geth^r, the most sensible conclusion is that ESAP schools were not 
'clearly 'different from control schools, they did not have marke^y better 
relations between races, their principals and* teachers were not b.e.tter .4 
dispoteed to integration or tg minorities, and *tl|eir students were also 
V yfery^ sllJiLlar . * o ' 
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- III. THE IN3£RACTIVE^gFF£CT-j3Ff jESAP ON NONCOGNITIVE OUJCOME^ 



The prevlou^ section Idoked at' tK^ef feet . of ESAP on 'ceachers, 
principals, and students without- subdivid^ing them in aay way; but it 
is both possible and likely that different groups responded in differ- 
ent wayjs to ESAP. 'Since? the analyses of athieveme^^t scores had indi- 
sated Higher achievement levels VjSS: blacto^male students in experimental 
schooX^,' the ^uestior? was raised whether ESAP had differential effects 
on other outcome variables for the students. For instance, suppoSe { 
black male st*adents in experimental schpols had;, greater cohfidence in 
their own ability than black mdle students in control schools, and 
swRpose that this difference fs not found for g>roups of different race 

. and sex.. Then one Ifnk will be suggested in the chain of" events^be-^ 
tween £SAP funding and educational achieveme.nt. .-Of coufse, it would 
then-^be necessary; to^ shoW that students' self-confidence was related- 
CO their -educ^Jtional performance, but at least the first step would 

' show a differential program effect on a noncognitiye quantity. 

* The analytic approach is simple but the interpretation of' results 
fairty complicated. The sample of students is divided into four sub- 

. groups: "biack males (N=906) , black females (N=10^7), v*ite males 
(N=1538f, and white females (N-1611) . ■ For any given outcome— say, 

^ sfudent sel f-rconf idcnce— the difference between the ;neans f or experi- 
mental and control . schoois is tested witWn each of the four subgroups.. 
In Table 2'eiich line show? the mean*" scores and the significance , level 
of the difference symbolized in the -conventional manner. Most of the 
variables are dichotomous, so the numbers to the right of the decimal 
point can be Interpreted as percentages. For -example,^ taking the first 

. ^comparisons, tite value of LSie^^^eans 61.6 percent of the black males 
in the experimental schools said tifey were in a school club or team. 
In the c'^p'tToI schools, 65.8 percent. of ^the black males said the same. 

""But not "ill ^ variables are of'^tHis kind, and car(ff^sKould be taken t,o 

' check the i-oding of oach variable in the left hand margin. 

• ' ** ' . * 

Before I turn to the results themselves, consider the kinds of 

t " . . 

findings that a«c pertinent ta^the inquiry. ^ 



^ 27 



CO 

op 

,J 
o 
o 

X 
CJ 
CO 

o 

oe: 

z 
o 
o 

o 

< 

< 
z 



2: 
w o 

pui o 
X u 
w z 
o 

o 

CO o 

2: 



X 

w 

CO 

o 



CO 

o 
o 

o 

> 



u 

c 

o 
u 



cu 

•H 



X 



4J 

c 
o 
o 



a. 



(U 


U 


iH 


C 




0 




u 




















a 


iH 















C 




0 




u 


















iH 






X 







00 

* 

•H 


lA 

in 
i-i 


CN 

/■ NO 

.^M 


1.728 




in 

H 
vO 


CN 

NO 


00 

iH 




v4 




iH 


m 

* CN 


0 


V 

ON 
ON 

in 

fH 


00 * 

NO 

vO 
iH 


1.614 


0 
00 

in 

iH 


NO 

vO 
T*' 


0 

. ^ NO • 

so 


•» ' • 

» a^ 

m 
in 


0 

in 
in 

: fH 


0 

CO 

in 

iH^ 


•00 
0 










in 
in 


nO 

in 


in 
0 
in 


00 


'fH 


tH 


iH 




00 

in 


cn 
^ tn 


CO 

NO 

in 


00 

cn 


r-} 


iH 




iH 


SO 
•H 

NO 


in 

in 


NO 

in 


00 

nO 






iH 


iH 



■K 
■K 



























CO 








D 








cu 




CO 




fH 




CO - 


CO 


>» 


00 


0) 




a 


fH- 


0) 
>^ 


•H^ll 
J3 CN 


•0 


II 




fH 


0 


li 






fH 


CN 




0 




CN 


U 


0 


D 


\ 


0 ' 


S: 


\ 


D 


c 


0 


0 






0 


0 


0 


II'. 




c 


CO 


0 


CO 


C 


jO 


!H 




II 




CO 




II 


(TJ 






fH 








jH 






c 


>w' 










U 


fH 


0) 












0) 


0 


•0 


C'* 




iw 0) ' 


u 








D 








•H 


(d 




s: 




0) 




II 






(TJ 


0 


CO 


CO 


CO 


CN 




>^ 


0) 


CO 




a 




Q) 






f 4J 






D 




^ 0 




0) 




iw 








S c 








0 




U 




0) li 


fH 










0 




E ^ . 






•H 


0) 


JJ 








4J 






fH 


0) 








c 




•H 


D 


fH 


a 


•0 




•0 


CO 


•0 






CO (d 




u 


0) 


4J 


(d 


D 


CO 


•H Q) 


s: 


D 




D 




0 


4^ 


4J 




•0 


fH 


0 


c 


ts 






u 












»^ 


C CO 


c 


)^ 




CO 










0) 


0 




u 


0) 








•0 


fH 




CO 


)^ 


•H 


+i 




D 


0) 


c 


0) 






^0 






CO 




u 




iw 




vi 


CO 


C 
D 


•0 

D 


0) 




•H 








0 


u 


c 


CO 


0 


CN 




H 


a 


CO 




M 







ON 


ON 


CN 








00 




in 


• 






iH 


CM 


fH*^ 


vD 






"CN 


< IS 


CO 


00 






fH 






00 


• fH ^ 


CO 


nO 


CO 






ON • 


CO 


fH 


fH 


j 


CN 


CO 


m 


On 




1 






CO 


• 


• 




•H 












ON 


00 


NO 




CO 


ON 


NO 






* 






fH 


fH 


fH 


CO 




CN 


in 


00 
















fH 


iH*. 


fH 


m 


00 


.00 


<r 


CN 


fH 




00 


in 


• 


• 






fH 


fH 










CO 


ON 


CO 


..CO 






l<. 


in 


fH, 


fH 


fH 



CN 
«H 



NO 
NO 



NO 

o 

NO 



ON 
NO 

in 



00 

NO 



CN 
fH 



o 



O 
CN 







CO 




fH 








fH 




1 




•0 








0 




fH 




' 0 














« 


















a 




CO 








0) 




CO 




(U 




CO 




00 

c 




0 




II 




(U 




•oJ 




w 




H 




















u 








00 




JH 




c 












0 




•H 




dd 




t* r\ 


es 


ho 




CO 












a 




00 










II 






c 








(d 


CN 






0 




CO 


> 


fH 




CO 




fH 




fH 




00 


0 


(U 




0) 


0) 


(U 






c 








0) 


.0) 




CO 


II 










M-) 




•H 


fH 








00 














s: 




0) 




(U 




(U 






11 




a 




00 






CO CN 








c 






fH 


\ 


CO 




CO 


•H 


CO 




0) 


0) 




II 




c 






0) 


0) 




0) 










iw 




CO 


u 


CO 


0 


CO 






00 




0 










u 


(d 




a 










C 


CO 


c 


CO 


c 


0) 


c 




0) 


•H 


0) 




0) 




(U 




•0 


•0 


•0 


In 


•0 


u 




0 


D 


II 


D- 


00 


D 




D 


c 




fH 


4J 


•H 




c 




II 


CO 




CO 




CO 




CO 


CN 



20 



r 



(U 
D 
'C 
•H 
iJ 
C 

o 
o 
I 
I 

CNJ 





u 


rH 


C 


OS 


O 


6 


P 


















o. 




X 


^ 


U2 




u 




c 




Q 


03 


































u 




c 




o 




o 


a; 












o 






£X 


r-l 




CQ 






iJ 


(U 


c 


fH 


o 














o 




03, 




iH 




> CQ 






w 



00 




0^ 


m 


m 


in 






m 


r-l 


CN 


o 


00 






in 
















00 


in 


m 


• ^ " 


* 




H 






rH 


O 


CNi 


ON 




m 


* • 












ON 


o 




' 00 


in * 






• « 


m 


fH 


00 « 


in 


00 


<r 


NO 








m 








rH 


in 




m 


O 










•H 


ON 


fH 


in 


ON 


H 


in 






m 


iH 



1-1 
o 

O ^ 
C •'H 

o *J 

OJ o 

a. e 

CO II ^ 
in'' 

0) 

E 

•H • . 
4J LfY 

- I 



iJ 0) 

C 00 

D C 

O 03 



(U 
>^ 

% II 

^ CNJ 
>-l 

o o 

> c 

■ (U II 

'-6 r-( 

O 

1-1 OJ 

O (U 

o 

fH 

O 00 

O C 

^ vH 

U U 

CO D. 

QJ 00 

f C 

or CO 

0) 

C (U 

D iJ 

O C 



O 

OH 



ON 



00 



O 
m 



in 
o 

OS 



00 



o 

O 



CO 



SI 
u 

00 

c 

•H 

1-1 

D 
T3 

00 

•H ^ 
tM O 

c 

03 H 
<N 

C ^ 
•H CO 
0) 

c 

0) It 
(U H 

03 03 
SI 0) 

^ fH 
O 

CO C 

03 U 
CO CO 



fH 
« 



NO 

m 



ON 
NO 

o 



00 
fH 

<r 

CM 



CN 
CM 



m 
o 



00 

c 

03 I 

QJ fH 
U 
XI 

0) 

1-1 00 

o c 

U-( 03 

o 

M-t 03 

CM 0) 

o 

^ SI 
w iJ 

O 00 
u C 

•H 

iJ 1-1 

C 3 

QJ 
CO 

CO 

C Q) 
OJ fH 

03 ^ 

;£ 4J 



CO 
D 



o 
o 
s: 
a 

CO OJ 



fH 


vO 


ON 




CM 








'd- 


iH 


CO 


CO 


a\ 




CNJ 




* 






fH 




ON 


' fH 


CNJ 


^ in 


o 


m 






<r 


iH 


in 






' CO 


o 


in 






sr 


, •H 




fH 


00 


r CO 


in 


nO 








iH 


fH 










nO 








rH 


CO , 


CT\ 




CO 




in 








fH 




m 








m 














CO 


iJ 


>s 


03 


03 


s: , 




u 


0) - 


CO 


1-1 


00 


O 


c 


B ' 








u . 





vo 



in 

CNJ 



o 

CNJ 

in 



00 

in 
in 



O ^ 



6 o xo 

O OVH 

UH O ,H 

03 u • 

> C Wi 

03 03 0) 

:s > 

CO OJ 

*J c 

03 - It 

•o c m 

W nH 

C ^3 • 

QJ m 

Ou OJ I 

CO ^ rH 

OJ OJ 

^ CO OJ 

3 00 

CO 03 C 

O 03 

03 (U Qt^ 



u o- 
o c 

UH II 
CNJ 

, X J CO 

g OJ 
03 

rH II 

X rH 

CO 

•H iJ 
iH 
OJ 3 

IC 03 
U-t 

CO 

CO 

03 •H 

CO 

iJ iJ 

c o 

OJ c 

3 OJ 
u U 
CO (0 



NO 
NO 

CO 



CO 

in 



vo 
>3- 



O 

CO 



> ON 

CO 



CO 



l-l 

•H 

03 
14H 

OJ 

1-1 

03 



O 
O 
SI 

u 

CO 
SI 



C CO 
'•H QJ 
OJ 

CO 1-1 

OJ op 
iH (d 

D H * 

1-1 CNJ 

CO CO ' 
>^ OJ 
03 OJ 
CO l-l 
00 

U 03 
C CO 

QJ -rb 

'V 'V 
O II ' 

U fH 

CO w 



vO 



O 
O 
in 



O 

vo 

,>3- 



CNJ 

CO 
>3- 



in 
St 
in 



CNJ 

in 



T3 

O 
o 

00 

6 

« 

f4 co^ 
OJ 

i.i OJ ' 
•H W 
00 
03* 
OJ II 
SI CM 
CO 

•H CO 
C (U 
3 OJ 

a u 

00 

^ C 03 
0) CO 

s: -H 



03 ^ 
SZ 

4J C 

o 

CO CO 

>s 03 
03 

CO u 



00 



CO 

CNJ 



O 
m 

CO 



vo 

CO 

vo 



CNI 

vo 



ON 

m 
vo 



vo 























03 






O 






iJ 










4i 


o 




O 


00 




^ 4 










CO 




fH 


OJ 




D 








» 




§ 


CNJ 


O 








OJ 


o 


CO 




C 


4i 




It 


R. 




fH 




OJ 






CO 






o 


fH 




o 


O 


CO 


SI 


O 




u 


sz 


O 




o 






CO 




fH 




CO 


D 


'O 




O 


Q) 




O 


X 






•H 


+i 


iJ 


B 




c 




+i 


OJ 


>^ 






fH 




D 


fH 




4J 


OS 




-CO 


•H 






O 


<r 


MH 


03 




M 





er|c 



29 



21 



c 

U 

C 

o 

. a 

I 



(0 



(U 






C 




o 


6 




(U 












u 




CO 


a 


r-l 


X 


PQ 


u 






<U 


c 


iH 


o 


CO 












U 




CO 




fH 


a 


PQ 


X 




U3 



ON 



00 
CN 



CM 

o 



as 



o 


CO 


t vO 




o 


•CO 




o 


00 








d 


d ' 


d 



tfs 

00 
<r 


00 


o 
'cC 

vO 


00 

as • 

00 


.152 


.000 


.845 


r-4 


CM 






o 


. o 





CO 




in 


CM 


00 


as 


o 


O 


CO 


m 


in 


as 












CM 


f-i 






as 


CO 


as 


CO 


^r. CM 








vO 


in 


00 




CM 







00 




vO 


CN 


o 


vO 


CO 




vO 








d 


d 


. d 



in 



CO 



CO 
CO 



o 
o 



00 
d 



00 


in^ 


' -cnT" 




CO 




in 


o 


CM 


f-l 




CO 


CM 




• 00 


O . 


o 


ON 


CO 






o' > 


o 


d 




vO 


c\r 




vO 




CM 


<r 




o 


CO 








00 


O 


o- 














CO 


»H 


f-t 


d 


d 


d 




vO 


CO 




> 

CO 


vO 




o 


vO • 




in , 










o 


Q 
















CM 








d 


d 




CM 


as 


l-l 




"d" 


CM 


r> 




CM 


in 


o 


O 


vO 






o 


ON 


CO 


iH 


. 'H 


d 


d 


o 



5^ 



to 




















CO 




a 












o 






D 
















(U 




.o 
















o 








CO 




CO 




O 


<u 


CO 




00 








0) 




iJ 


CO' 








a 




4J 






c 






r-l 




ICO 


> 


•H 




to 


o 






CO 












c 


a 






•H 














CO 


J= 




a 














0) 






CO 




c 




c 




iJ 




O 




u 




ha 




ha 




ny 




(U 




c 




iJ 




iJ 




CO 


0) 






















iJ 




o 




U 


(U 


U 


0) 


0) 


*J 










(U 


CO 




CO 


> 


•o 










iJ 


c 




c 


CO 


II 


o_ 




o 




V4 


o 




& 




o 








o 


CO 




m 








CO 




CO 


c - 


B 


CO 


B 


CO 


iJ 


0) 


iJ 




iJ 


il 




(U 


CO 


(U 




0) 


c 


o 


c 


CM 










c 


^ 


0) 


c 


(U 








(U 




CO 


00 




il 




CO 


M 










CO 


D 


CM 


D 


(U 


CO 


(U 


CO 


(U 


o 


If 


iJ 




iJ» 






JZ 








t-l 


CO 


CO 


(0 


II 


CO 


u 




XJ 




\^ 


(U 




H 


oy 


o 










CO 


>s 


CO 




u 


II 


a 


It 


o 


CO 


(U 


H 


(U 




•H 


o 


CO 


o 




;o 














f-i 




O 


(U 












CO* 


Xi 


CO 


a 


c 


M 




M 


D 




(U 




0) 






O 




a 




CO 




CO 


>> 


CO 


i4 


CO 




CO 




>s 


II 




tl 


>s 


CO 


(U 




(U 


CO 


• CO 




• 2 




CO 


s 








CO 


CO 








C/3 


CO 



as 

CO 
CO 



^00 
cor 



CP 

-d- 

CM 



CO 
CM 
CM 



00 

as 















00 




in 


ON 




l-l 




• 


iH 








CO 




in 


' in 


CM 


C9 






iH' 


iH 






iH 


r^* 


00 


00 


CM 


CM 




V • 




l-l 



CM 



in 

CO 







O 


















Q) 




o 






U 




CO 






CO 


<U" 


u 


^ 




u 


6, 
co- 


u 


o 




CO 


co 




CO 




0 








B 


iH 


u 








w 


o.- 






o 


CO 








u 












XJ 








CO 


o 


XJ ^ 








c 


CO 


CO 




iH 


II 






CO 


CM 


O >s, 






XJ 




II 








CO 


XJ cs 






CO 


<u 


c 






u 




0) o 






c 


n 


TJ C 






0) 


iH 


D Jl 


o 




13 


\^ 








D 










4J 










CO 




CO 0) 








CO 


c 






(U 


^ 


73 O 






(U 




(U ^ 


+i 




u 


(U 


iH tL 






6 


iH 


H 


O 


XJ 


CO 


CO <U 








CO 


a 






CO 




XJ 






>s 


(U 




in 




CO 




CO C 






to 


XJ 


5C O 



•t 

I 



ERIC 



30 



22' 







a; 






fH 


c 






o 




a 


o 




























U 




1 


H 


a" 












w - 



o 


iJ 


—J 


C 


(0 


c 


E 


o 






a. 








o 










X 


PQ 


w 



NO 



v0 
v0 



■K 



CM 

in. 



in 
in 



\0 

in 



fH 

in 



CM 

in 



O 
in 

CO 



00 

in 



o 



CM 
CM 



ON 
CO 



in 

CO 



CO 



00 

. O 



v0 



00 
O 



O 



00 

o 



o 



N0 















u 












•H 








CO 












(U 
u 




Q) 






CO 


•H 


(U 


O 








s: 




(0 




o 




u 


U 




' u 






O 










no 


II 


u 




0) 


CO 


C 


o 






^ o 


■U CD 


(0 


CO 


- x: 




Ur >> 






u 




II 


Q 


CO 


0) 


O 




> CM 


*• >^ 




>>'^ 






0) 


o 


II 






e o 


?0 O 


CO 


fH 


x: 




o c 


fH 








x: II 














S 


00 


fH 






X ^ 


' 0 


o 




u 


c 


O 






'f4 0) 






x: 


ij 


CO 


5 o 






(J 


c 


0) 


CO 


•H 


CO 


0) 


>> 


CL U 


^' 




0) 


no 


H 




o o 




D 


CM 


0) u 




CO 


E 










CO 


CO 


0) 


O 












c 






C 


<0 


II 


O o 




0) 


0) 


cH 






0) 


x: 


no 




IM 




CO 




a> 




no O 


. ^ CO 








0) 








o 


X C 








s: 




(0 ^ 






oo 




0) 


no 




o 


c* 


-no 


H 








•rf 




o 


(0 U 


so 




O 


PC 




X CO ' 






00 



in ' 



in 



CM 
O 
CM 



v0' 



O 



in 





















•K 










■K 














twi 


-CO ^ 


CM 


. O 


iH 


fH 




00 


. in 


• 




• • 


• 


• 


o 


o 




j 




fH 


in 


in 


fH 


00 


o 


CM 


00 


OM 


CM 


fH 




in 


00 




• 






• 


• 


O 


O 


.H 


fH 






ON 


■* 

as 


CO 




in V 








00 


■fH 


fH 


in 


OD 














O 


O 


fH ./ 


fH . 


iH 

f 


00 


CM 


00 




00- 


CO 




ON 






fH 


fH 


in .* 


00 




• 




• 


• 


• > 


o 


O 


fH 


fH 


fH 












ON* 






ON 


do 


00 




in 


vC 


CM - 


fH 


fH ' 


00 


CM 




• 








X ♦ 


o 


O 


iH 








• 




1 




CO 


<t 




'fH 


CM * * 


CO 


CM 




00 


ON 


CM 


fH 


00 


c>i . 














o 


. O 


fH 


■ fH * 


«H 

• 


in 


CM 


vO 


1^ 


ON 


o 




iH 


CM 


CM 


CM 


fH * 


00 


CO 














O * 


O 


fH 


fH 


fH 




1—1 


in 




^' o 




-a- * 


in 


in 


ON 




fH 


00 • 


CO . 


^£ 












o 


. O 


iH 


fH 


.H " 



CO 











no 


no 








C ^ 


C 










(0 


(U 












c 




CO x: 


CO 


iJ 




u 






O 






o o 


(J 


11 


CO 


x: 


CO 11 


CO 


o 




ij 


fH O 


fH 




o 


o 


jo 




CO 


'CO 


II 


CO 




0) 


fH 


o 




00 


>> 


XI 






c 


II 




CA 


■H II 


•H 


fH 


00 


0) 


^ H 


^ 




c 


>> 


•H ^ 


•H 




•H 


11 


fH 


fH 


fH 




fH 


. W fH 


(ft 


O 


•H 




•H O 


•H 


O 


fH 




no O 


no 


x: 




fH 


x: 




(J 


CO 


O 


CO o 


CO 


CO 


CO 


O 


CO co^ 


CO 






x: 






0) 


c 


o 


C 0) 


c 


E 


0) 


jp 


0) E 


0) 


CO 


(U 




0) (0 


0) 


(0 


CO 


(U 


CO 0 


y) 






E 






iJ 


fH 


CO 


fH 4J 


CO 


ceo 


CO 


CO 


.CO 


u 


•CL 


CL ^ 


0) 


CO 




0) 


•H CO 




(U 


U 






o 


iJ 


c 


iJ 


c ^ 


<o 


•H 


•H 




•H -H 


0) 






iJ 




H 




<0 





CO 
(U 

•H 

x: 
o 

u 
u 

•H 

(0 

.c 

D 
00 

c 

•H 

0) 

jO 

CO 
(0 

c ^ 

0) o 
CO c 

il 

CO CM 

u ^ 

0) CO 

(0 II 
0) fH 
H ^ 



CO 

o 

(0 



•H 

CO 

c 

D 

00 

c 

0) 

CO 
CO 

c 

0) ^ 

CO a 
II 

CO CM 

u ^ 

0) CO 

>> 
II 



o 

<0 



00 

c ^ 

•H O 

c c 

•H II 

»(0 CM 
fH ^ 
CL CO 
E 0) 
o >> 

O II . 

fH 
CO ^ 
(0 

CO 

c ^ 

0) CO 
CO fH 

CO 

u O 
c ^ 

-O ^^ 

D CO 

4J H 

CO 

•H 
0) M 

4J O 
•H > 

^ <o 

3 ii-i 



31 







u 




•H 












- 






c 


fH 


o 




o 






a; 








•H 






o« 




X 








4J 


iH 


C 


to 


o 


6 


o 














o 




•to 




fH 




PQ 


U3 





4J 


CM 


00 




c 




fH 


fH 


o 






to 


u 


fH 


^ CO 










M 




CO 


ON 


o 




. O 




to 


.a 


in 


. O 


fH 


X 






CO 


U3 


iH 


. cn 









23 








\ * 

\ 






* 


















* 








'*\ 
\ 




i 




























i' 




^ -K 








a) 




\ 




<T 








CM 




\ 




fH 


<!- 






. ^ , 00 ' 






CO 


• CO 






m 




00 






♦ 


♦ 




• 








fH • 


CO 


CO 




fH 


iH 








CO 


rH 




CM 


ON 






CM 


o 


CO 




CO 




<• 




CO 
• 








in 




CM 




• 


• 




• 




00 




iH 


CO 


CO 




fH 


fH 








f 








* 


i 




d 


- vO 


ON 




m 




• 








fH 




o 


CM 


CO , 






CO 






in 








• 




* 




• 


• 






fH 


CO 


CO 




fH 
























CM ^ 


o 


fH 




ON 


00 






00 


ON 


sr 




CM 


/< ^ 




• 




CM 






in 








• 


• 


. • 




• 








fH 


' CO 
/ 


CO 




fH 


fH 








fH 


o 




in 


in 






fH 


in 


in 




m 










fH 


vO 




in 


in 


CO 




• 


• 


• 




• 


• 


in 




fH 


, CO 


CO 




iH 


fH 




- 


CM 




C<J 




CM 


CM 


• 




<r 




<r 




m 


C4 










vO 




\n 


vO 


O 
















in 




fH 


CO 


CO 




H 


iH 







00 



ON 

vO 



o 

fH 

in 



ON 
fH 



00 
CO 



vO 


iH 


fH 




O 






00 


vO 


<r 


in 


vO 










'ro 


fH 


fH 





o 


(5 






C <-N 




•r4 O 




c c 




•H II 




to CM 




fH 




a CO 








o >% 




O II 




fH 




W ^ 


. CO 


to 




CO 




C (U 




a> 4J 








CO X 


CO 


CO 






4J O 


CO 










6 




3 CO 




U "H 




CO 4J 


40 


•rl 


CO 




O O 




to > 




.H to 













1 














(U 










T 










a 














(0 • 




o 






O 






• fH 


o- in 




a 






4J 




H 




B 1 
















(U > 


O iH 




o 










> 


> (U 


O 




4J 




60 


o 






<U fH, 










(U 


3 /-N 




fH 


fH 


>% (U 




>% 




fH 


g (U 


c . 




fH 


4J 60 




4J 








o 


m 


fH O 


•H C 




•H 




O 






o 


o o« 


fH to 




fH 




O 


> 60 






• • 


•rl 




•H 






to to 


(U 
















X CO 


CO 




to 




to 


in 


•H 


to 






CO 






1 






' jj 


JJ 4J 


CO CO 




U-i 


fH 


o 


O II 








•H to 




o 




60 


C tN 






















to 


to to 


O 








fH 


CO ^ 












c 


60 


fH 










O CO 






c 








* C 


. c c 


•H 




6 


fO 


•I- 


60 




to 


to to 


bO X 




CO 






to 




o 


o o 


C 




CO 






(u n 


si 


•H •H 


•H C 




(U 


(U 
















CO 






>^ 




•H 


•H •H 


to 




CO 


^ a 


CO /-s 


CO 




* C 


C C 


M CO 




to 


(U 6 


>% CO 






60 


60 60 


U 






fH O 


tO' (U 


to O 




•H 


•H •H 


CO a> 




/ CO 


fH O 


CO • 


CO 




CO 


CO: CO 








O 


H 






II. 


tir II 








O 'O 


4J CM 


'U 3 




c o 




c 


fH 


C ^ 


C O 






0) 


60 


(U 


(U 3 


(U O 






•K 






•H 


t3 




C 


73 a 












3 


a) o 


3 II 


3 








4J •H- 


II 


4J 


fH It- 


4J fH 










C/5 ^ 


m 


CO 


a m 


CO ^ 


CO ^ 









(1) Thi first-class of finding would be one where black males 
in experimen tar schools have a more "favorable"' score than those in. 
concrol" schools, but the difference' does not^show up for the- other 
race-sex- groups. This might mean havipg hlgjier self-estefem, as in 
the example given above, or more frequent contact with terac^ers, or a 
more poslbive view about students of the opposite race. / i- 

(2) Black males- in experimental schools are no different from 
those in contro^ schopls with respect to the "dutcome variable. But 
at the same 'time, some or all of the other race-sex groUps- are worse 
off in th,e experimental schools than in controls. Suppose-black males 
have the same level of self-confidence whether they are in experimental . 
or control school^. Further, imagine studepts.in the other race-sex ^. 
groups hfd lower levels of self-conf idrtice if they were in the experi- 
mental schools. Then it can be argued .jshat black males in experimental 
schools enjoy a relative advantage, and one. that might acc<3unt for their 
higher level' of achievement.- ■ v > ^ 

(3) The third class of-fdnding is more complicated sti-ll. Here 
black males are worse off on- some nopcognitive outcome if they arp! in 
exp^ri^^ental schools, but 'the outcome measure turns out to be negatively 
related to achievement. For example, black males may be less self-, 
confident, in experimental schools,- while students of the other race-sex 
groups are more s^lf-conf ident if they are In the expertmental schoo-ls. 
Further, imagine the unlikely event that ' higher - levels of self-confidence 
•are associated Jith lower levels of achievement. Then -this would 'indi- 
9ate a possible explanation for the supferior perf ormanc.e of bla^iTc males 
in experimental schools. 

The results of the analysis are presented in Table 2. The dependent, 
or outcome, variables are put into seven groups on the basis of the kind 
of attitude or behavior they measure. The. first four variables- -deal with 
students' interaction with the school and, more particularly, the level 
and ease.of their communication with' the adu.lts in the school. The 
supposition is that the more students are involved with their teachers 
or counselors, the more they^are integrated with the school and the 
greater their chance of doing well. ' ^ . 

'The seqond .group, student's feelings about the sx:hpol., deaUdirectly 



with students' a'ttltudes toward the school arid^towafia' scfi'661 work. 
Some measures are readily interpreted; * if a student says he 'hates 
schcfol', it probably means he doesn^t like being there*, but others are 
more ambiguous. For example, the amount of time a student spendg on 
homework may indicate his enthusiasm for school, but it must also re- 
fleet the t^eachets' demands, regardless cf what the student feels. 
.Further attitude measures deal with the amount of trouble students .get 
into and the extent to which they find the rules fair? 

Since ESAP* {>as aimed at,* improving race relations, students* atti- 
tudes ""to those of a different race (fourth part) are obviously impor-^ 
taitt., as well as* their level of interaction with tfiem (fifth part). . 
These two classes of variables coritain measures of attitude to other 
racial groups, the amount of 'self-reported contact, and. an index of 
stereotyping. - ' . . • ' ' - 

Variables in the sixth .group deal with students' perceptions of 

teachers' attitydes toward desegregation and minorities. On course, 

this will TeH-e^ both the teachers' actual behavior and the way stu- 

•dents respond to' and interpret- that b.ehavior. Finally, the last part 

contains foun measures of students '^ "self-esteem or feeling of self- 

worth, r \ * 

'^The results will be discussed in terms of the three kinds of 

* ** 
findings outlined above. The first question is whether black males 

in experimental schools scored higher on these variables than similar 

students in control schools when an experimental-control difference 

was not found in the other- rkce-sex groups. It turns out there are 

two statistically significant differences between experimental and 

control schools (out of 40 comparisons) , but in bpth cases the control 

school. students, not the experimental school students, score highest. 

This eliminates the most likely area for future inquiry, since the 

program does .not appear to have any positive effect on the noncognitive ' 

outcomes for black males. » 

There are similarly straightforward comparisons for the other three 

groups: Black females: There are six variables for \*7hich the. • 

experimental-control difference is statistically significant, and for 

five of thesQ the 'difference favors the experimental school. White 



males: All of the five significant comparisons show .experimental' 
• * * ' ^ ' \ 

school students scoring in a more favorable direction than cortrolX . • 

students*' White females: Here the sitfiation is reversed^ since six \ 
out of eight significant comparisons favor the control schools,' The 
-TTesults far the white males and white females suggest a qiiestipn for 
f-uture study— that^^ these changes had an indirect effect on black male 
acliievement. For, instance,' it is imaginable that the program improved 
white male attitudes to integration in a way that mad^ the school en~ 
vironment less threatening for black males, and this in turn, ma^de it 
easier for them to do their work and score better on 'tests. This in- 
quiry.will be reported in Section VII. ' " 

The nexLJdlnd of ffnding is that bUck males iti experimwtal 
schools score at the same level as those in control schools, while 
experimental school students in the other race-sex subgroups score at 
a lower level' than the 'control school students. Of course, if all the 
remaining three subgroup^^.show^ this pattern,, the result ^wouid have 
added significance. However', n^^)ne ^of the variables analyzed in Table 
2 showed this pattern. ' A more modest standard is to compare the re- 
sults for black males with .tliose for; black fe^les, which , will expose 
the sex-related interaction, and then with results for white males, 
exposing the race-related interaction effect^ One interaction pattern 
"Tits the first condition, ^one fit the se'cona:: The dri^that does show 
up is a variable measuring interracial> contact. Students were asked • 
if they had called a student oT ♦a different race on the phone. • THere 
' is -no difference between black mal^s in experimental and control schools 
but there is a significant difference between black females; the control 
school, female blacjc students reijo'rt higHe^ levels of interaction than 
experimental school female black students. ' If this variable is a de- 
terminant of achievement levels, the finSing is of importance, since 
.black male students in experimental schools then have a relative ad-' 
vantage over blaqk females in these schools. The importance of this 
-nohcognitiVe variable will be explored in the next section., 

• The final class of /inding is more complicated ^till, since it 
--requires black males to be worse off, on the noncognitive variables 
— used here,^ if they are in the experimental schools; and the differences 



between ^experimental and contjroi, students for the other three race- 
sex groups are either inslgnif icaht , or positive in favor of experi- 
mental schools • This scenario als^o requires that~Ehe noircognitive 
variable in question is negatively cortelated to achievement. Here, 
too, one variable follows the required pattern-. Students were asked 
if there was an adult whom they could turn to if they werer jupset or .in 
troub;Le^^ A significant differente is reported in favor of control 
school students for black males, further, there is no impvccant dif-" - 
ference between experimental and control group students for the other 
three race-sex gtoups on this variable. This indicates a noncognit,Jve 
variable of potefttial importance, and I shall look at the association 
between this variable and student achievement scores in the next '.section. 
In this case, the association has to be^negative to support an explana- 
tion of the hlgKer achievement scores of-^black males". 

In conclusio;i, although there^ are no Instances in which black *male 
s(?udents in experimental schools score higher than control, ^tudents^ 
(wttile other race-sex groups do not), f}, few noncognitive variables^ show 
a promising pattern of results for explaining the -relative difference 
in performance be,tween black males ^nd the other subgroups. The rela- 
tionship between nqncognitlve outcomes and achievement will be de^lt 
with in the next section. A huge number of comparisons are made between 
experimental and control schools in Table 2;'some of these are'going to. 
be statistically significant, and among those will be found some fi'lBng 
th§ pa-tt us €hat aije interesting to this analysis. In other words, we 
might expect some positive results by chance, but the results arte noc'^t 
all consistent in the sense that they do not turn out the same way fop 
variables that measure similar quantities*. ^ 
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IV.. RElATIONSHIPS BETWEEN STUDENT NONCOGNITIVE 
VARIABLES AND ACHIEVEMENT SCORES 



* In sjearcih'of the^-causes ofc higher black male achievement in ESAP 
scht)ols, the analysis investi||ates the, way noncognitive variables re- 
late to achievement scores 'fot the four race-sex groups. If the rela- 
tionships vaU across subgroups the finding might suggest ways of ex- . 
plaining ESAP's effect on black male achievement. For example, it ♦ 
might^'be th^t students' self-confidence was more strongly related to 
educational] performance for black males than kor other subgroups; per- 
haps becausje they are more vulnerable to distufbancfes in the school 
than other jgroups and profit most frora^ any improvement in their self- 
c^>nfidence.' To test this and other propositions, the sample is divided 
into the four sex and race groups.'^ Withii\'each of these groups, zero , 
order correlations are produced' fo?; each of the nohcbgnitive variables 
and student achievement levels. The general" question Is whether, foi? 
a given variable, these correlations ^show significant variation across 
the foilr race-sex groups. * 

This raises the question of how to judge "significant yariation." 
For one thing, the reliability of the achievement test is not exactly 
the same for each group^it is .85 for black mal^, .84 for black" ^ 
females, .91 for white males and .90 for -white females). So reliabil- 
ity will account for some of the o'bserv^d. variation. However, it , turned 
out that , the corrections had an inconsiderable effect on -.the tattejrn of 
cotrelations. oThe question thfen Is'howi-to judge- if a set-of fpur cor- 
^relations is similar or different. There are tw9 approaches: one 
based on'tests of statistical significance, the other on-the relative, 
values of r^.' If the first standard i^ applied,.it takefe.only small . 
differences between tyo correlations for them to be judged unlike one 
* another. For example, a correlation of .07 is statistically*^ significant 
at p = •OS, when N = 906 (as it does for black males^^, while a correla- 
tion of .10 is significant at p = .01, for the ^ame number of casea, 
Tlfe difference in staJti^tlxjO-^^ indicates the two 

ifeirartonT'a^^ different. However, the predictive 
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efficiency of these^ correlations should also be considered. From *this 

point of view, a correlation of *07, which implies the independent 

variabi^ might account ^ for ^ half of 1 percent of the variance in 

the dependent variable,' does, not seem much different frdm one^of ,10, 

which' accounts for ,1 perc^ent of the variance. The issue then is what."^ 
2 ' 

^difference in r is goin^to be considered a quantum for the purpose 
of the analysis? An arbitrary choice was made of one percent-age* point 
of the total variance — that is, two' correlations are considered to be 
ditferent from one another if one accounts for an additional 1 percent 
of the dependent variable variance. This means a correlatiorf'df ,1*5 
is judged different f rota' pne of ":330;>so,is a correlation of ,122 dif- 
ferent from Qne of .070. These examples illustrate tha.^int that as 
correlations get ''bigger, >t-hQ required difference gets smaller. In the 
analysis, both of these standards are used. Statistical significance ^ 
levels will be 4>ised to-declde if correlations are different from zero; 
arid r^ will be relied on to judge if two Correlations are substantially 
different from orve another.' 

\ In reporting on Tahle 3, I first lookat the le^ds suggested by 
the analysis in Section III. There, two noncognitive variables were 
identified as being relevant to the explanation of the higher achieve- 
ment scores for black males. The first is a measure of t.he students' 
contact with others of a iJifferent race, defined by whether they caUed 
someone on the phone. Althorugh- no significant, difference was foun* \ 
between black males in experimental and control schools, black females 
in control schools had^ higher levels of interracial contact than did ^ 

^ those in experimental schools. If it can lie found that this ^.oncognitive . 

/measure is po^tively related to achievement, it wiM suggest- thai^piaqk 
males in experimental schools were better off than black* females in ex- 
perimental schools, at least in the sense that they had a relative ad^ 
vantage over thqm* , The variable turns oiit to be positively correlated 
with achievement (Table 3, "Part 5) , and the correlations for three of 

' the four groups, though all smaller than 0.1, are also>?statistically - 

* *^ 

•significant. This suggests one l^ad that could account for the relative 

superiority of black males in experimental schools. However, using the 

* ^9 * * 2 » 

* values of r , the correlation f.6r black. males (r = .03, r = .0009) is 
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Table 3 



ZERO ORDER CORRELATIONS BETWeIsN MEASURES OF STUDEMTS' 
1 ' NONCOGNITIVE VARIAPLES AND XHEIR AC'.tlEVEMENT SCORES. 



Noncognitiye Variables- 



1 



MacV 
Male • 



Black 
Female 



White 
Male 



White 
Feinale 



(1) i-^vel of interdotion in 
(school * . . 

Tf student is a member of a 
scHpol cliib or sports team ' 
(l«no/2=yes) , 

If student had talked wit|;i 
school counselor during year 
(l«no/2=yes) ' 

Student^talked wl,th teacher 

about outside interests* ^ ' 

(l=no/2=yes) 
♦ 

I? 

Is t-here an adult student 
could go to in trouble 
(l'=no/2=yes) 



.07 



»* 

.07 ^ 



-.01 



-.01 



*** 

.d5 

% 

■k* 

.10 



.05- 



-.03 



.15 



.04. 



.05 



.03 



,1k 
I 

.04 



.06 



-.00 



(2)' Students" fheling about 
the sahobt 

Student 'feels he belongs in 
the school (l=disagree/2=agree) 

Student says h^ feels happy 
(high scorO=hap^y) 

Says he is glad, to go to schoq^l 
in thq jnornihg (l=no/2=yes) ^ 

t t r 

Student says^he hates school ^ 

Amount "of time spent on home- 
wi^rk (Range: 1-5. 5=mc/st time) 

Fouh^ either schoolworUt or. home- 
work interesting during .week 
(l=no/2==yes) - ' 



.06 



-.04 



-,06 



;04 



.01 



-M2. 



-.05 

39 



.07 

i 

-.07^ 
ft 

.09' 

1 

i 

.11 

i 

-.07 



.08 



.12 



.08 



.20 



,06 



.07 



.07 



.11 
-,02 

.12 
. .02 

-.03 



4rM 
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Table 3 — tontinued 



r 



Non^gnitive Variables 



Black 
Male 



Black . White White , 
Female Mal-e • Female 



(3) • Getting into trouble 

Says he had b9en in a 'fight 
du^ring the school year- 
*(l«yes/2=no) . ^ 

, * ' • . • ' 
Had been sent to the office 
fop' breaking the- rules during 
the year (Range: 1-3) • 

•c . ' ' 

§ays„ he spent days away from 
school just becauSe he didn't 
want to come (Range :'l-5. ' , 
5=ttever . . .1*16 or rsore days).^^ 

Student says he is blamed for 
'things that are not his 
fault Cl=yes/2=no) 

Student says tules in the 
school are fair (l=dlsagreesi 
2=:agret^,s) ^ ^ 



.04 



.lOo. 



.08 



k-k-k 
•113 0 



.02 



.13 



S04 



Says that when purtiffhed it^ is * . 
for n* good reason (l^diisagrees/ \ 
2=agrees) ^ ' ' , ;^ \ ' T '^-.04 



.21 



,04 



-.06 



kkk 



A6 



kkk 



.15 



kfi 



n'l3 



kkk 



.17 



'kkk 



.14 



-.01 



kki( 



.07 



kk 



.09 



.10 



.05 



kkk 



.08 



-.05 



kk 



(4) Attitudes to studenU of 
# " the obhev race 



If student could choose, he 
would go to a racial^ly mix€"d 
school (l=no/2=yes) 

Would like more friends of the. 
other race .(i=no/2=yes) 

Feels uncomfortia^le with stu- 
dents ^'of the other race" * 
.(R^ngi/« 1-4. 4=no) ^ 

Describes students of* the *oth*er 
race as dumb (l=yes/2~no) 



kkk 



^14 



.08 * 



,15 



kkk 
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,19 . 



.08 



,12 



.17 



.19 
» 

.19' 



..13 

- . 02^ 



*** 



;i5 



.08 



.03 



-.01 
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, .Table 3 — continued 



Noneognitive^ Variables . ^ 



Black Black White • ^ White , 

Male %»-Female ffale • Female 



Describes student^ of own racial 
group as dumb (l=yes/2=no) >^12 

Says whites are smarter than* ' 
blacks (l=yes/0=other response) -.01 

Say^' blacks are smarter than , , , * 
whites (l=yes/0=other response) -.08 



Says cdloj doesn't have any- 
thing to do wi't.h smartness 
(l=agrae/0=other) 



.13 



is* 



.13 . .%,12 



-.02 ' ' .01 



-.10 -.08 . 



*** 

.11 * .01 ' 



.08 



** 



.10 



-.02 



-.10 



C5) Interaction with students 
. of the, other race ^ \ 

Says three ^t^dents talVs to 
jnost are of . the same irate 
(l=yes/2=n6t all same) 



T-MO 



** 



.10 



-.04 



Had called a stujjent of the 
other race on the phone 
{l=noA2=yes) 



.03 



.07 



.09 



i08 



Had helped- a sfudent of the 
other ra;ce with homework 
(l=no/2=yes) . , • . . 

Had asked for help with home^* 
work from ^£adent of other 
raQe^.(l=no/2=^'yes) . - " ^ 

«(6) Feraeption^of teacher's 
attitudes to desegvega- 
tion and minorities 

Teachers seen ia$ liking blacks^ 
and whites goitng to^ same school 
' (l«ytes/0=other) 



.05 



.08, 



-.01 



Teachers seed- as disliking 

blacks and whites at same 

school (l=yes/0=other) -.04 



,14 



.05 




.02 / .01 

f 



-.01 '/ -.06 



.05 
.00 
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^ 'Table 3 — continued 



Noncognitive Variables 



1 



Black 
Male 



• ' Principal, seen' as liking blacks 

and whites at same school \ ^ 

\07 • 



(l=yes/0=other) 

Principal seen as disliking 
blacks and whites at same 
school (l=yes/0=otHer) 



X-'-Ol 



\* Teachers seen as beiig unfair 
to blacks (l=yes/2=no) ^. .03 

Teachers* seen as bolpg unfair ' ^ 
to whites (l=yes/2=no) » -08 



Black 
Female* 



.08 



-•03 



-.02 



-.03 



White 
Male 



.05 



.06 ^ 



White 
Female 



-.02 



.11 



^•02 



.01 



-.11 



.01 



' (7) Student's sislf^esteem 

Student's ratitig of his. abil- 
y ity compared with others, in his 
f ' 'class (Range: 1-5) 

Stu/dent's assessment "*of a^>il-t ^ 
ity to complete colleger^ 
(Range 1-^. 5=could complete) 



,32 



.33 



AAA 



AAA 

39, 



.39 



■■)' 



i6 



.47 



.45 



.48 



•Student says be will go to 
college (l=no/2=j;es) . * .25 

r ' 

"Student.^says he does not hav^ 
much to be pro.ud of (l=agred/ 
2=disagree) ^ -'16 

. ' N based on : 906 



AAA 



.28 

.21' 
1037 



*** 



.40 



\^ .12 
]^538 



..41 

.18 

1611 



-k-k-k 



significant at the .05 level, 
significant at the .01 level, 
significant at the .001 level. 
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not appreciab:|.y different from the cori^ation for black females 
(r = .07, r' = .0049) in that the larger correlation potentially 
' accounts for le^s than one-half of 1 percent of additional variance. 
. The se>:ond variable tha,t was identified as having possible im- 
portance in accounting for the performance of black males Hs a measure 
of their .interaction with adults in the school. The comparison showed 
that black males were more likely to say. there was an adult they could 
turn co^ in trouble if they were in cbnTrdtnsxrtioois than if ^they were 
in experimental schools. FurtHer., there were no significant differ- 
fences between the two types of- schools for the other three race and 
sex groups. If it is liow ^bund that this noncognitive variable is 
negatively correlated_wj,th achievement, it will suggest a possible 
chain of events that led to the higher performance of black maples in 
experijnental schools. These correlations are shown in Table 3, Part 1. 
In three of the four groups the sign .of the correlation is negative, 
which suggests it is either a disadvantage to feel you can go 'to an 
adult if vou'need'to, or aelse that the kinds 6f sdudents- who either 
want or need- to have this .kind of contact with adults are less likely 
to do well in school work. In any case, although the sighs of the 
. correlations are negative, they are also all indistinguishable from 
zero. Therefore, although the correlations suggest a causal sequence 
•that is important, it is possible that the true value of these correla- 
tions, is zero or positive. 

The second way of inspecting Table 3 ignores, the findings of 
Section III and looks for any evidence of relationships that are di^ 
ferent for the four race-sex groups. Given^his aim, the search is 
for positive correlations that .are stronger for black male 10th 
graders. Or,, where the noncognitive variable is coded so^that a ?-ow „ 
^core is favorable, the search is for negative correlatiorfs that are ' 
.weaker for the black males. 

' Students' attitudes to those of the other race (Part 4) seem to 
fall intp the first category. That is, ."favorable" responses to these 
'"^'questions are more .s_trongly associated with achievement for black 

males than they are'for.the cher race-sex groups. Take, for example, 
the last variable in Part 4, if the student says that race has nothing 
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to do wit)i being smart. Disagreement is Interpreted as evidence of a 
more favorable attitude toward others *and toward oneself, and this is 
anticip'aired to mean a better disposition toward school work and to 
possible academic success* 'In ^ny ^event, *it is found that the faVor- 
able answer to this question is more strongly related to achievement , 
for black males than it is for the. other three groups. This means the 
belief that racV^nd smartness are unconnected is more important for 
•.this subgroup than the jothers. It should be added that this is race- 
linked rather than sex-linked. Black males are little different from 
black females. But blacks (of both sexes) seem to be quite ><lifferent 
from'whit6s (of either' sex). 

~This finding is more or less supported for other measures of • 
attitude toward one's own race and .the opposite race. Disagreeing 
that either one's own ethnic group ^or the other one is "dumb" seems ^ 
to be more closely associatad with high achievement f9r blacks than 
it is for whites (Part 4). *But though this suggests that self-image 
and image of the other ethnic group and^ perhaps, the facility of 
intergroup relations' a,te more important to ^blacks, than whites, ^here 
is'^contradictory evidence 4hat cannot be lgnore.d. For example, the 
idea that self-image is hiore important for blacks than for whites is 
undermined by the correlations reported in, Part 7, which show self- 
esteem' is almost always less closely associated wifcli^achievement for 
blacks than for whites. * Equally, it does not help bl^ks^ if they feel' 
that blacks are smarter than whites (Part 3), though ptedictably enough 
it hinders them-if they feel whites are smarter .V Therefore there -has 
to be some uncertainty that self-image or image of the oth.er race is 
going to explain differences in achievement levels of the four race- 
sex groups. However, this is the most promising line of inquirjj opened 
up by this part of the analysis arid deserves further attention.. 

The^obvious question is whether .ESAP funding can be linked with 
these noncognitivG variables for black males. The answer is found in 
Table 2 Part 4, which shows clearly that control school students, not 
experimetital .school' students , had more favorable scores^"*on the two most 
important attitudi^iial variables (Student says race not linked to IQ, 
and does not describe own race as "dumb"). In other words there is no 
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chance pf linking ESAP funding to these noncognitive variables, even 
though the linkage between them .and student achievement could possibly 
explain the dif,ferencq.s* in. achievement level among race-sex groups* 
.The second question is 'whether particular educational programs might 
account for the differences in student attitudes, . This will be pur- 
sued im Section V. 0 . , 
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V> WHAT DID ESAP MONEY BUY ? 



Up to this point the analyses reported her4 KaVe treated ESAP as / 
^program consisting of additional funding aimed at helping schools 
make progress with desegregation. This is the most comprehensive way ' 
of Looking at the program. But also ignores another level of re- 
ality. Money was translated into kctiops — resources and- programs ih 
the schools—and ,th^se activities Wi.ll.be the Subject of the rest of 
this investigation,, Spe9if ically , what were the* federal funds used 
for in schools? And were apme programs more effective than others? 
The destination of ESAP. m\)ney "was dedided/ in part, at the local level, 
and,''not surprisingly, different schoil districts concocted di^^ferent . 
schemes. The activities authorized by\ the bill put very little off 
limits (notably, ESAP money could hot be-' used for busing; where it was 
already ih use tq fulfill the requirements of a court-ordered desegre- 
gation plap) . 

It is extraordinarily difficult talspecify the content of the 
program inWmple and precise terms. ESAP paid for' remedial Education, 
the devQrloprtient of instructional methods,! the repair of buildings, 

* efforts' to involve the cbmmunity in the sAhool, training for teachers, 
hiring "teachkr aides*, secretarial assistance — the range was wide. This, 
presents obvious problems to the analyst who wants to make accurate 
generalizations about the r ature of the program. The problems, are com- 
pounded by th4 terms used by the eValuators.^ For example, how certain 
is it that "inservice training programs" really have enough in common 
to be sensibly \defined as a single set of activities? Or, njpre. simply, * 
what -did "comprehensive planning" consist of? Again, when ESAP paid 
for, counseling, \what did this involve and which students benefitted? 
Working at thi^s distance from the program there is no hope of retrieving 

' the answers; the^best that can be done is to cross-check different 
sources vof information collected by the evaluators . The definition of 
program types will\ be. reported on below. 

Yet, tfiere is a more basic paint, one that turns this part of, the 
secondary analysis into a general inVeiftigation of the effects of 
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different program types rather than art investigation of the effects of 
ESAP-funded programs ♦ To make the point concretely, I shall anticipate 
the task of analyzing the etfect'of inservice training programs* From 
the 'point of view of the evaluation of ESAP, the relevant issue is 
whether ESANfunded inservice training programs were more (of less) 
effective than other ESAP-funded activities. In other words, how does 
this use of program fund^ compare with other uses? 'The- first step in 
such, an analysi^s wpuld be to identify schools with ESAP-funded in- 
sorvice traini^ig programs. This can be done with available data,^ But > 
having got^ to this point it cannot be assumed that tKe other ^schools 
do not have inservice training.- Other experimental sch9ols may have 
this kind of program, funded by other sources. So too may the control 
schools have inservice training, funded either by ESAP or other sources. 
So unless it is claimed that the ESAP-funded u^e^rvice training is 
qualitatively different from programs funded other means, the analy- 
sis cannot go ^forward. There is no evidence that ESAP-f unded-programs 
were. special in any respect; therefore, the question has to-be rephrased 
Instead of ESAP-related activities, the objective of the^analysis fhust 
f>e to investigate the effects of different programs regardless of fund- 
in^ source. 

^It is important to stress that by altering the question the in- 
vestigation is no longer strictly an investigation of ESAP. It becomes 
an inquiry into the relationship between educational programs and out- 
comes, such as student attitudes, without regard to the origin' of the 
programs. It is also important to emphasize th|it this analysis cannot 
ctipitalize on the strengths of the randdmi^zed design because program 
types were not randomly distributed among districts. So it is only 
reasonable to suspect particular circumstances were associated with 
particular progra^m types. For example*, it might be that schools that 
had experienced a lot of racial tension will be more likely to choose 
inservice training with an emphasis on intergroup relations. A school 
with lots of slow learner^ might b'e more likely to use ESAP money for 
remedial education; some of these possibilities will be investigated in 
the second part of the section. There is a reasonable possibility that*- 
program type is confounded with other *scl ool leVel factors, and these 
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factors may well account for variations in outcomes. ^ The point Is 
.that the analysis is hampj^r^i Jby the usual constraints of confounded 
Independent variables . 

The issue addressed in this Section is how best to char^acte'rize 
the program types. ^. The information used for this purpose is obtained 
f rom^ . thr.ee sources,, the first two of^which are much the mo^t imp6i;tatit. 

THE E SAP DIRECTOR SURVEY ' ' ^ ' 
. — c i 

The^^SAF 'dii'fe'iiVdSp was .most usually the. person responsible for 
federal programs^ in phe district, but sometimes it was- the superintend- 

dent. He, or his assistant, was int.erviewed and asked about the. use 

* ■ r ' 

of ESAP funds and it is important to note that only the dire'ctotr sur- 

vey refers to ESAP (see below). Further, most information the director 

supplied related to activities and programs in the schools^ rather than 

in the district as a whole. And filter questions were added to chi&ck 

- - ^ ' ■ - ... . . ^ 

that these activities were ones that 10th grade students could have 
participated^ in. 



i 


Informant 
asked if ESAP 
funds boughft 
program? 


Do data re- 
late to the ' 
school or 
the district? 


• Is program 
available 
to 10th 
grade? 


Genferal program description 
(e.g., inservice trai^ning) 


Yes 


School 


Yes - 


Equipment (e.g., AV equip- 
ment) » 


Yes 


* 

School 


Yes 


Specific inservice (e.g., 
remedial, education) " 


Yes 


School 


No 


Specialists (e.g. teacher 
apict^^) 


Yes 


f School _ 


Yes 


General program (description 
(teacher aides) 


.' Yes . • 


District 


^ No . 
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TH E PRINCIPAL SURVEY 

The principals, .unlike the directors, were not asked about the 
us^^^^f ESAP money. Their answers provide information about the re- 
sources and programs in their schools regardless of funding source. 



- i 


Did ESAP 
buy program? 


Do data 
• relate to 

school or 
' district? 


Is program 
available 
to 10th , 
grade? 


) 

Programs, courses, pr 
personnel ' 


No . 


School 


Yes 


Additional. funds for 
equipment of different 
types 


No 


School 


No 


Existence and contetit 

of inservice training 

.1 


No 


School 


No 



THE TEACHER SURVEY . . 

This is the least Important survey for the purpose of program 
identification; it was not designed to find- out what activities there* 
were in schools. However, incidental questions do touch on the 
teachers* experience with a few programs, and this information will 
be used to cross-check the existence of programs in schools: 







r r 


Do dat^ 


Is program 








relate to 


available 






^Did- ESAP 


school or ' 


to 10th 


^ f 


•f 


* buy program? 


1 district? 


grade? 













Program in parent- 
teacher relations 

Minority courses or 
texts * ^ 

Teacher had had in- 
service program 



No 



No 



No 



School 



School 



School 



No 



No 



Yes 



PROGRAM TYPES 

These data are used to define 11 dichotomous variables identifying ^ 
progr^TO type (program presence contrasted with absence). These are 
different categorieg^ from those used in previous evaluations of ESAP^ 

(RMC, 1971; NORC, 197.3), and there are three reasons for the creation 

<, 

of new variables. First, unlike previous investigators, I have tried 

r 

to avoid crej^ting composite indices.^* Since the terms: used' to identify 
ESAP' activities were broad enough to start w^th, there seemed every 
reason not to compound the problem by putting several " program types 
together, in one variable. Besides, NORC's factor analysis -of programs 
and activities (NORC, 1973, pp. 35-41)<^did not encourage the view that 
the data would yield readily interpretable composite indices. Second, 
with the .limited set of 4^ school pairs, it turned out -that many programs 
were, not^ represented in the sample of schools. A variable for program. 

'type was discarded where there were four or fewer schools reported to ^ 

have a particular program type. A gre.at many of the variables , turned 
out to fail this test;/ for the director survey, 41 out of 75 variables 
were not used for this reason. Third, the definition of program types 

-was guided toward activities that might plausibly be used to improve 
educational "achievement or ^alter racial attitudes. 

The first program type,- inservice training for teachers, like most 
of the other programs, ds identified by both the director and the princi- 
pal. The directbr^ survey indicated that there were 23 experimental schools 
and 11 control schools with inservice teacher training (see p. 42). The 
teacher survey, however , 'indicated 38 ' experimental and 34 control schools^ 
with insBTvice training. Diffefent schools are identified by directo'ts 
and" principals, most, X|.kel;y because the principal gave information abbut 
programs of all kigdWi not just ESAP funded activities. 

The breakd'bwn separates experimental and control schools to bring 
out two^poliits. The director identifies a substantial number -of control 
sChoopf^i '^11) as having ESAP-funded inservice training programs ^Th^re ^ ^ 
are 1^5' experimental schools (38 less 23) with inservice training funded 
by non-ESAP sources. The point has been made before: There is little, 
sense in contrasting scHools with ESAP-funded inservice training and 
those without. Many of the residual schools have inservice training, 
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and many of the control schools have ESABrfund^i^d Inservice tra4^1ng. 
Th^ same point is implied in the following summaries. 



SEnsewice ttaining with 
emphas-is on intevgvoup ^y*^**" 
relations 

Director survey^ 
Principal survey 

Ineervioe training with 
emphasie i>n remedial 
' education 

9 

Director survey 

Inservice training with 
emphasis on teaching 
methods 

Director survey 
Principal survey 

Inservice training with 
emphasis on curriculWi 
ievetopment 

\ ' 
DiMctor survey 

Principal survey 

Prov^sion of remedial 
educatum ^ 

Director survey 
Principal survey 

\ 

Curriculum development 

Director survey 
Principal survey 

•V ■ ' 

Programs to increase^ dontact^ 
.between school anSi cd(munity 



Experimental 



\ 



Director surveV 
P.rincipal survey 



\ 



Focus on relations .betweeri\^ 
student^^ ' \ 

Director survey ^ 
Principal survey 

- V / ' 



il 
31 



10 
38 



9 
38 



AO 



3 
30 



10 
29 



5' 
31 



Control 



4 

26 



4 
36 



3 
32 



3 
36 



20 



5 
15 



. 0 
23 



/ ■ 
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CoucB^s ov mdLteHals oriented 

tPDord minority groups . Experimental Control 



Director survey 



3 0 



Principal survey * • 13 * 17 

Provision of teacher aides 



Director survey 



Principal survey « 29 23 ^ 

j: ■ ■ t, 

These summaries bring out the point that ESAP money was spredd; 
over ^11 kinds and!;varletles of educational progt^ms^ Tfitere Is no' 
single or dominant* theme, except perhaps that tlt|l taoney seems ^ to have 
been used far teacher tr^nl«g, especially training with an emphasis 

rlntergroup relations^ and on teacher aides. And in vlew^of 'the size 
d timing of the grants in each school, it is likely these programs 
did not amount^ to profound, deep-cutting changes In the organization 
of ,the sc>iool but were more probably short-tetm remedies ahd responses 
to integration.' / 



/ 



A NOTE' ON PROGRAM DELIVERY 



So far only the. director and principal data have been used to 
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determine what the ESAP money was used for. But since the inatter is 
• so impoiytant, ifc is worth taking one step farther by^looking at the \^ 
teacher purvey :data. The^purpo'se of doing this is -to^ ^ee, if the - 
teachers', answers corroborate the- information given by director and 

•pri'hcipal. • . 

Teachers were asked several questions about the resources in their 
school, particularlji^^S-they were affected. For example, thfiy-^wefe 
asked if they had taken any inservice training during the yea\, how 
.Qften they had discussions in class about race, and if they had learned 
^ about handling intergroup relations amppg students. They were also^ . 
asked about. the school In general—for example, whethier the ^school had 
made efforts to get parents to visit the school during the year^ or 
whether there had been special projects (plays oir group discussions) 
tha(t dealt with intergroup problems. Data from these ^questions werq, 
aggregated at the school level to give an average teachers* scorle for 
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each school* Thus, if aXl 'the surveyed' teachers in a school reported 
they had. had iftservifce training, then the aggregate score for that ^ 
school would; be 100; if i uolf had received^ training, the score wb^ufd ^>e 
50; and s^o on. These aggr^g^'te teacher^ resppns^s can then be related 
to data, obtained from thk director and ^principal surveys i If the pro* 
gram was effectively delivered 'in the sthool,\there will be reasonable 
agreement between' the twoAource^ of information-. Thel^e is oite* caution. 
The program described by thevdirector may not have been , intended for 
the 10th graders or their tea^^iers, so lack of consistency may *not al^ 
ways poilit to ui^cert^inty, about the existence of a, program* • *^ 

In some areas, the director and princip'al data check out. very poorly 
with the teacher information. For example, if schools^ are divided on the 
.basis of the director data into those that 'had programs to deyelop 
.parent-teacher relations and those that did not, we fitid that teachers, 
^in the first Category of schools are less likely to report ^h^ir schQol. ^ 
was "tryinjg harder' this year than it had in the past- to. get parents tp«- 
visit the sciiool or come tbu PTA or other.pare^it groups." The aggregate 
teacher response (in agreement with the question) for the» first kind 6f 
school was 18.0, and in the second kind of, school, 30.6. If the same 
che£fc is done using the principaldata, the '^comparable figures are 28.4 
and 28.7. .In other words, the teacher reports Imply ESAP made little . 
difference to the program schools. 

In .other areas there is greater consistency^ For example, schools 
J where the director said there weje ESAP-funded ind^rvice training pro- 
grams (available to the 10th grade teachers) had teachers who were more 
likely to report receiving ihservice training than schools without this 
program. Schools were divided on the basis of directors*' information 
about in&^rvice tr^j(.nin'g. In the schools^ \&ith this program, 63.2 percent 
of the teackers, on average i said they had had some 'inservice training*. 
Where thfesre ^as no program, the, average response fell' to 51.8 percent. 
However, wlifen the principals* information is used, this difference be- 
tween program and nonprogram schoctls disappears (55-5 percent of the 
teachers said they had had training in schools without, and ^5.9 percent 
iaid ttiey had training in schools where pr^ograms ifete reported). 
^Better agreement is obtained abou& whether teachers received 
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inservice training with an emphasis on lntergroup^j)r* race relctlons. 
.When^,,.£ither the. director or the principal says the school had a program 
of this kind, the teachers are more likely to say they had had some 
training In this area* Schools where the director claimed Such a pro- 
gram had an average *of AA.?*" per\ent of the teachers saying they trained 
in iTicergroup delations (37.3 percent In schools without these program^) < 
Schools where? the principal clalm^id this kind of program had an average 
of 45.8 percent of the teachers reporting training In the area (27.7 per- 
cent of teachers In the schools without). This coherence Is dlaturbed 
only by the fact that teachers In sclipols with Inservice training .In ' 
irttergroup relations were les^ likely \to repojRt they^ had learned Kow to 
handle i.ntergroup relations than teachers In other schools. But one 
f^irtUer check gives weight to the. positive sldel . Teachers were* asked. 



If they had class discussions about race.^ They were more likely to sajr. 
tho^ had these discussions If Jt;hey were In a school that^ reported in- 
service training wlth**dn emphasis on race relations. 

Finally, there Is greater likelihood that principals and teachers 
will concur about. , the ^xl-stence of tourijes.ln minority t)l,story or cul- 

ture» Teachers were considerably more likely to say there was a course 

\ i s . . V. * 

of this kind In the school (35 perceTnt) If the principal Indicated 

thqre was than they were If the principal said there was no minority 

courae (te^achers: 7.1 -percent) • ^ t 

* * ' \ ' ' 

lit is clear the teache*rs' information does not help a great deal 

in identifying what ESAP consisted of in the schbV>ls. Sometimes their 
reports suipported what the director said ESAP fumls had bden used for; 
mcirfe usually^they did not. This null fitidlng is ambiguous, as pointed 
out in the beginning. Without much more precise Information it is pos- 
sible only to say that thls.^onf licting evidence warrants real concern 
about the implementation ^of ESAP; it does not prove poor implementation. 

WHY Dip SCHOOLS -'CHOOSE THEIR PARTICULAR PftOGRAM ? 

•The^tlSAP money was used to buy a variety or different programs and 
services^ -It is reasonable to think that -the choice? reflected locafl 
needs; trte supplementary tunds bought things that the principals or the 
district administrators wanted ^most*. If so, there should be^ some 



relationship, (between the characteristics of the schools and tUte programs 

they got / fo see if there were relationships" lof this, kind, the program' • 

variables were cross--tabulated with a set of variables that characterize^ ^ 

the schools. The latter included the school' sjracial composition,, the 

principal's evaluation of the quality of his, faculty, the principal's 

attitude to desegregation, the year desegregation had its greatest ef- ^ 

feet on "the racial balance of the schbol, and the level of -racial "tension 

in the school during, the previous year (indicated by\whether -the schooj. 

was closed),. Since the data were not collected jwith this analysis in 

mind, it is^^not surprising that thislist is shdrt. Th^se few variables 

describe schobls ifi only a limited way. 1 

" With one' exception, the an^lyse^ provided np evidence\ that the ^ 

schools' characteristics or special problems wer^ related tb the kinds 

of programs they had. The exception is that schools that ha^ inservice 

• training pro^grams with an emphasis on race relations were mor^e recently 

•desegregated than other schools. This -makes sense; a school just going 

\through the process' of desegregation is presumably in- greater 'nejed of 

programs that deal with the' relationships between ethnic groups. And 

the idea that tfiere "are special, temporary problems involved in desegre- 

'gation received somfe modest ^support in earlier analysis (Section II). 

However, it would be. equally sensible to expect that , schools that had 

this kind of i!?5ervi,ce training for their teachers would>also have 'ex- 

• • » ' • . • ^ - 

.periericed- greater .racial tension, they. might have principals that were 

more in fayor of desegregation, or they might have a particular racial 

composition.- But no association was* found between these three variables 

and the presence" of'' this kind of' prograih (the. criterion for deciding if 

.two variables were associated was that x should jexceed the value for 

.p = o.wr^ . ' . • i , ■ . 

The rest of the analysis revealed' no\ other relationships between 
program type and school characteristics'. 'For elcample, the principal's 
evaluation of the quality of his faculty .is not associated with the 
probability that the school has an^ inservice training program, nor are 
programs that concenttate on remedial education more likely to be found 
in schools where* principals feel that blacks' failure can be attributed 
to the restrictions imposed by white society rather than to students' 
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own failings* Schools that *chose programs to^help with the relatio^nr 
ships between ethnic groups are not unusual in their racial composition, 
the^year in which they desegregated, nor- in the level of racial hostil- 
ity in the school (measured by whether the school closed because of 
racfal problems). Finally, schools that^ chose to spend money on teadher 
aides seem to have had just about^])^ same student-teacher ratio as 

those t.hat did not. / - ** . - 

\ ' ' ' 

With the exception of the /relationship between year of desegrega- 

/ ' • ' ' . 

tion and ihservice training programs focused on race .relations , thfere 
are.no revelations about the circumstances that led to the selection of 
part.icuiar programs- This most proBably means that we do not have the 
appropriate measures to characterize the^schools.. However, it is then 
possible to infer that the spools did not get the most appropriate kind 
of program from the point view of the principal,^ administrators, or 
students • ESAP funds were made available after the beginning of the 
school jear, and the decision about fund usage was not entirely made a't 
the school lev^l; these fa/cts give some weak support to this inference. 



\ 
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VI. RELATIONSHIP' BETWEEN PROGRAM TYPE AND;- PROGRAM OUTCOMES ; 
TEACHER AND STUDENT ^ONCOGNITIVE VARIABLES 



ProgranH-l:y^e variables ideat'ified in Section V are used here to 
investigate the effect these programs' had on noncognitive outcomes. 
The purpose is to see "if the existence of the programs in schools is 
associated with changes in'*"attitudes and teported behavior of teachers 
and students.' Program type variables are derived from the pr.incipal 
survey, which m^ans the analysis is a general Investigation of the 
•"t lationship between educational- activities and outcomes. As pointe,d 
out before, the analysis is not tied to the Emergency School Assistance > 
Program. * , , 



TEACHER OUTCOMES 

There are many teacher attitude variables, the dependent vari.ables ^ 
in this analysis, and there are 11 program type variables. .-Interrelating 
each program type with alL.possible outcome measures would have produced 
an indigestible array of results, so selection was called for. The out- 
come measures chosen were those I thought most closely represented the 
things .ESAP was trying to change. They fell into tjiree categories:^ 
teachers' attitWes to desegregation and to minority students, teachers' 
attitudes to tl;ie academic potential of students, and teachers' self-. . 
report on how they' felt about teaching that year. The dep.endent vari- 
ables were divided into these three groups because" it seemed likely 
that different outcomes would be influenced \by different program types. 
For example! it seemed likely that teacher training in race reiati9ns. ^ 
would have more of an effect on attitudes* to des^egregatio'n than it would 
on how much teachers enjoyed their job. Of coursev- thia kind of teacher 
training might have an .effect on job satisfaction to^, but parsimony , 
directed attention to the best bets first. Accordingly\dif f erent 
.selections of program type variables wete related to each ^^KJthe three 
sets of variables def.ined above. The first part of the analysis uses _ 
the simplest possible approach:" a comparison of means the outeo|ne 



\ 



measures for schools with and schools without the program. The. dif.f erefice 
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between these means represents initial indication that the program 'is . ^ 
associated with a difference in outcprocr: 

Teachers • attitudes to desegregation and to minority students are 
represented by 14 variables (Table 4, Part A) that deal with their ^ 
feelings about racial mixing in schools C^o you think' blacks j^re better 
off in racially mixed schools?**), with their self-reported bdlfavior in- 
class ("Do you have discussions about ijace?")' and with their perception 
of other teachers' attitudes to desegregation. These were identified 
as possible outcomes Jor^ three kinds of educational programs. TI?p most 
obvious ""'is teacher training in race relations , which is assumed to be 
directly aimed at changiifig teachers* attitudes • concerning racial issues 
in the school. The other^ two, the presence of co'urses in minority 
history or culture and unspecified teacher training activity, though 
less obviously connected with attitude change y were assumed to have an 
indirect effect on the same ctass- of outcomes-. • ^ ^ 

General ins^rvice training programs are nop associated with any 
significant differences. in teachers/ attitudes. *For example, they do 
not lead to more favorable teachers' attitudes toward minority students 
or to the value of .desegregation, nor do they change teach'ers' openness 
with stuijents about the matter of race. This is most probably* because 
of the great variety of activities included under the classification 
"inservice training," each with somewhat different objectives. ,By 
contrast, teacher training specifically directed at race relations is 
associated with differences in attitude and reported behavior, which, 
from the point of vieu of the program, must be regarded as .favorable. 
Teachers in schools with these programs are more likely to think white 
and black students profit from raciajl mixing, their personal attitudes 
to race relations are more favorable, and they see their fellow teachers 
black and white, being better disposed to desegregation. When schools - 
have courses in minority history ^or culture, the teachers are also more 
likely to have favorable attitudes on some of the same outcojnes; the 
effect of this program is somewhat less pronounced than that oi inter- 

vice training emphasizing race relations. - 

As always, these po^^itive conclusions must be balanced against 
some familiar disclaimers. First, tfie effects are quite small ones, 
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even though they are statistically significant. For instance, 75 per- 
denf^oR the. teachers in schools with race relati^ons inservice training 
---and 68 {Percent of the teachers in schools that did not have this kilod 
of program said black students would be better of f ♦in racially mixed 
schools, a*dlfference of ?• percent.' Though statistically significant, ^ 
and undoubtedly of potential pr^actiq^^Tlimpor^ce, this kind of differ- 
ence cannot be called overwhelming, ^gdcond, in dealing with a sensitive 
/ issue like racial attitudes, resporiaeftts are likely to give sociaUy 
-Correct;' answers rather than their true opinions, particularly, if they 
have just been through a course to sensitize them to some b.f the issues 
connected with desegregation. ''In other words, there Is an inevitable ^ 
problem of validity with self-completed questionnaires. We cannot be; 
sure, just because teachers told us so, that white teachers were really 
more favorably disposed to desegregation. StilLiless can we conclude 
^at their attitudes, as perceived by other teachers, were connected 
with th^ir behavior. ^ Nevertheless, we are looking for clues rather than 
certainties, and we have to strike a balance between agnosticism and 
naivete. ^ 

A* final problem with these results .is that they are heir to the 
"^sual limitations' of post hoc observational surveys^; in other words, the 
observed differences might well be attributed to other causes than the - 
one under coYisideration. Specifically, the differences in teachers' 
* attitudes might be attributable to other background characteristics of 
these teachers rather than to the program in the school. Accordingly, 
-regression analyses were run that are an^ogous to the t-tests reported 
in Table 4 yet that allow for control of other ind.ependent variables. 
Two^ were. chosen: teacher age and length jDf experience with desegregated 
schools. The clear conclusion of thi^s* analysis was that the controls 

^or these characteristics did not significantly alter theVelationships 

* • * / 

between program type and teachfer attitude. 

• Another possibility was that characteristics of the school might 

, explain the observed differences. One promising counterexpianation of 

the effect of inservice training in race relations* was "based on the 

earlier finding that recently desegregated schools were more likely to 

have this 'kind of program. Also teacheiTs' perceptions of the racial 
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climate in the school were ^related to the recency* of desegregation. 
Therefore the differences in attitudes that are apparently due to the 
existence of a prograto might really be a reilectioij- of this stage in 
the desegregation process different schools, have reached. According-ly , 
^9 second series of regressions were run where controls were intro"^ced 
for the time the school Jiad been desegregated. Two dummy variables 
were entered identifying schools desegregated during 1971 and those 
desegregated during* 1969 and 1970. The introduction of these controls, ; 
like the^iearlier analysis, Jid not alter the original conclOfiion tha| 
the program was associated-wi-t+» •more-i-avor^bie'-attitudfe outcoraes. 

.The second part of tlie analysis (Table 4* Part: B) looks at the 
way teachers evaluate the academic potential and performajjce of their 
Students. The outcomes h'ere 'cover teachers'* 'estimation of the studenl^^' 
ability to get into collesge and of the.'proportion of black students \ 
p^tformin^g "up to* scratch^^" their opinlorr about student^' performance 
in general during the year and about the reasons black students do .n9t 
achieve "equality." . * ' 

These outcomes wer^ related to three kinds of programs. . The most 
promising one --identified schools with programs ip remedial education. 
The other two were both inservice training activities, one that concen- 
trated on curriculum development and the other on teaching methcJd. 
None of these programs seemed to make a consistent difference to 
teachera* attitudes about students' ability or capability. There are 
tv/p^ Statistically significant results, but they are overwhelmed by the 
other nonsignificant differences." This apparently discouraging result 
quite probably indicates the ambivalence implicit in remedial programs; 
for although they may encourage^mdre. positive attitudes on the part of 
* teachers, the fact that "underachievers" are get'ting s.peciali7ed treat- 
ment in the school may encourage a negative att;^itude. -Those predisposed 
to think black students are\ uhlikely to succeed may be confirmed in their 
views if they see these students getting e^Htra hel*p." 

The f,inhl piece of analysis (Table 4, Part C) looks at a measure of 
^job satisfacrtion: teachers' responses to a question about how much they 
enjoyed teaching during th.e current J^ear compared with last year. This, 
though far from' ideal, was the best available measure of their disposition 
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to their job. Three program types were relate^ t(^ this outcome; two • 
identified the provision of aides^and counselors ih^ the schools, and 
the third identified ..teacher training that .focused o\i teaching methods. 
None of thes,e program types was -associated >?ith Statistically* sig- 
nificant differences in the dependent variable. Again, this m^y be ^' 
because' teachers do not appreciate the efforts of aides or .counselors, 
or it may be that these programs really do not make life easier for 
-teachers, la any case, there is no discernible relationship^ between 
these, prograriis and teachers! attitudes to their job during tKe year. 



In conclusion, the s'trongest evidence of program eftec^sVs con- 
tained in the first part of the analysis, specifically with the\,analprsis 
of inservice training focused on race relations. It can be argu^ that 
this is as it should be.* ESAP wasy\ intended to assist the process.\of 
integration and teachers' attitudes are certainly an important element 
in that process. Programs, ^me of them funded by ESAP,- t,hat aim di^ 
rectly^ at changing racial attit,udes are associated with 'the expected \ 
effect. There must be reselrvations ''about the finding, but xt is a posA 
itive indicatiop of program success and- it points to areas for more \ 
complicated investigation, to be reported in Section VII*. 



SXtfDENT OUTC i 
\ The a i 



OUTCOMES • ' ' ^ 

lysis of student outcomes is similar to thtit of teacher out- 



comes, the issue is whether there are educational^ .pra^-^ams , that can be 
related to differences in*students' perceptions, attitude^, and self- 
reported behavior. The question is directly reUted to ESAP's goals of 
improving the quality of relationships in desegregating schoals.* The 
measures of ^tudent outcomes used in the analysis give some indication 
of the way they felt about their ^school, the way they saw the t^ac/hers 
.an(J- principal, their interaction with students of the opp9site rac^, 
and th^lr self-esteem.. 

Six of the program ty^pes were chosen for. analysis' on the basis of 
assum{5tlons about the possible and -likely connections between educational 
programs and students' attitudes and behavior. Each program .variable is 
entered in a regression analysis and its effect on the dependent measure 
is represented b^ the standardized partial regression coefficient. This 



method of analysis was chosen because it provided the ^mpBt convenient 



; / 



way of controlling for other independent variables, in this case a 
measure of home background (years of education ^eompI6te3^ by student's 



mo 



ther) and the percent of white students the, school;' Both variables 



- ,* if , 

entered first in the regression analyses^*- prior tb the dummy varl* 
identifying program typ2. In Table 5lthe standardized- coefficient- 



were seen as'"pdssihj.e determjlnants . of student at]t:^.tudes and were there- 
fore 

able identifying program typ^ 

\ . * . . - 

for the program type variable (with associated level fort where beta 

t * V ' \ ' 

is statistically significant) is^the only information' reported .^frotn 

the^e analyses. . 

The total sample of students is divided intiO the tour race and sex 
igroups.. This is consistent \/ith the general aim of thi^ Inquiry to. \ 
supply an explanation of the *ESAP efffect on blac;k male^^cHlevement. To 
repeat, I am not looking here at the effects of programs that were ex-- 
clusively funded by ESAP, but: at the efifects of progr^s'^Unded by many 
different sources in the hope: of '^identifying effective strategies. This 
is\the nearest approach that can be made to the preferred analysis. As 
a first step, student noncognitive variables we/e selected for analysis 
on t^e basis t)f^l:heir correlation with achievement scor,es. This, too, 
was- justified in terms of thej overall' purpose of identifying intervening 
<^r4ables~here the student njoncognitive measures— that might explain 
the association between progrlani type and. student achievement. Clearly, 
it makes more sense ta investigate dependent variables that account for^ 
variance in achievement. | 

The analyses are presented in Table 5, which divides the results 
on the basi.^ of program type, i Some of /he programs appear to have little 
effect. FoCr example, PartA 6f Table's shows the coef flcients^ f or gen- 
eral inservice training programs. These, with_one exception, are sta- 
tistically insignificant, which suggests inservice training is^not 
associated with either higher or lower levels of student attitudes. This 
may not be too surprising sinc^ a variety of objectives are Subsumed unde 
this brjoad category of prpgraras and since inservice training is*dirj^cted 
. at teachers, not students* • 

^ . Other "programs are associated with more favorable .student attitudes- 
One of these is inservice training that concentrates on race relations^ 
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>/ Table 5 ^ 

MULTIPLE REGRE§SION. ANALYSIS OF RELATIONSHIP BETWEEN 
PROGRAM TYPE VARIABLES, AND MEASURES OF STUDENT 
NONCOGNITiyE OUTCOME, BY RACE-gEX GROUPS- 



Dependent Variables 



Black 
Males 



7 



Blajk 
Females 



White 

Males 



Part A: Analijsis of Insewice [Training Program for Teachers^ 



Student '9 rating of his 
ability compared with others 
in class 



.06 



.01 



9 

.03 . 



White '\ 
Females • 



, t 



-.02 



Teachers seen as liking * j 
blacks and whites at same 
school., ,by student ' 

Student ^.had called student 
of the othel^ r\ce oif the* 
phone « 

If studenl could choose, 
. would go to a racially mixed 
school 

Student says he hates • 
schooi 

Student is a member of 
school club or sports team 



r.03 



.05 



.01. 



-.01 



.02 



.03 



.01 



.Oil 



.01 



-•.03 



.01 

\ 

.03 



-.OA 
-.04 ' 
.03 



Part B: Analysis of Inservioe Training with Emphasis on Race or 
Intergroup Relations • ' • 



Student'^s rating of his 
ability " compared with others 
In .class < 

vTeachers seen as liking' . 
blacks, and Xi/hites at same _ 
s\^hool, by, student 

.•Stuiient.had called student 
of thd others race on the 
phond '.. ■• 



.05 



• -.10 
(2.87) 



.00 



-.01 



.00 



.03 -. 



.05 



-.02 



.07 
(2.78). 



,-01 



.04 



-.03 



-.00 



.05 . 
(l-?9) 



.04 



■ *** 
.09 



(3.52) 



,09 



I- 



(3.61). 
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Table 5 — continued 



Dependent Variables 



Black 
Males 



Black 
Females 



Vhtte 
Males 



■White 
Female&i. 



Part tf; Amlyaia bf Inservice Training with Emphaata on Raoe on^i 
Intelpgroup HelatirOria ' (continued) ' ' ^ t 



If student could clioose, 
<iould go to a racially 
mixed school 



.09 



(2.62) 



.07 
(2,31). 



,08 

t3,17) 



Student says he hates ^ " , • " ^ 

school- . -05- .-.06 .04 

Student'^^is a member ,qf school <> 

cluB or, -sports team * ' .01 .04 -.05 

Part C: Akalysia of Ins&rvioe ^^Tvaining with Emphaaia oirTtadfrtng 
• Methods . ' " , ■ ' 



Sjfudent's rating oS his, 
ability compared with others 
in class 



-.01 



-.01 



.07 
(2.6g) 



.08 
(3.'21) 



?01 



-.14 
(5,53) 



.03 



Teachers seen as liking 
blacks and whites at. same 
sc4:iool, by student 

S^tudenk: had called student 
of the other race on the 
pbone [ 

J. 

If .student could chooae, 
. would^^o- to a ' racially 
mixed school 



Student isayrTie^^hates 
school . * 

Student is a ^member of 



.01 



-.06: 



-.06^ 



-.01 



school" club or sports team -.06 



.07 
.05 

f 

-.04, 

-.05 
-.00 



-,00 



.05 



..** 



.07 
(2.87) 



.02 
.02 



,05 



.08 
.(3.37): 



- * 
.05- 

(2.095 
.04 



-.01 
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Table 5 — continued 



Dependent Variables 



Black 
Males 



Black 
Females 



White 
Males 



White 
Females 



/ Part d": • Analysis of Programs in Intergroup Relations among Students 



Student*^ rating of his. 
ability compared with others 
in class 



Teachers seen as liking 
blacks and whites at same 
school , ;hy student 



.08 
(2.32) 



.02 



.02 



.06 
(1.98). 



.06 
(2.32) 



.03* 



.03 



.01 



Student had called student 
of the other race on the 
phone * 



-•02 - 



\ 



.04 



.08 
(3.10) 



(3 



,09 
,61) 



*** 



If Itudent could choose, 
would go to a racially mixed 
school t' 



-.01 



,10 , 



(3.13) 



.06 
(2.26) 



(3 



,09 
.76) 



Student says' he hates 

school • , ■ .00 

Student is a member of 

school club Qr sports team -.02 



.02 



. .08 
(2.63) 



-.02 



-.03 



fart E: ■ Analysis -pf Progvams in Minorivy Culture or History 



Student '.s rating of hio 
ability compared with others 
in class 



.04 



.02 



.05 



.01 ^ 



(2 



.07 
,64) 



.02 



Teachers seen as liking 
blacks arid whites- at sa,me 
school, by student * 



Student had called student 
of; the other race 9n the 
phone , 



.04 



-.02 



60 



-.02 



.08 
(2.61) 



.00 



.07 
(2.67) 



.03 



,08 
,16) 



Table 5 — continued 



Dependent Variables 



Black 
Males 



Black 
Females 



V 



White 



■] White/ 
Females- 



Part E: Analysis o\ 



Programs, in Minority Culture or History (continuei 



If student could ch^^se, 
would go to a racially 
mixed school ^ 



Student says he hates 
school 



-.07 
(2-15) 



• 00 



Student is a member 



of 



schpx)l club or sports team 



• 00 



.00 



-•02 



• 07 

(2^22) 



Part F: Analysis df Program in Parent-Teacher Relations 



Student's rating ofl his. 



ability compared wi 
in cla$s ^ 



th others 



* Teachers seen as l::king 
blacks and whites at same 
school, by student 



, Student had called 



• 07 

(2^32) 



-•01 



• 01 



.05 



student 



, of the other race in the 
phone 



If student could choose, 
would go ^to a racially mixed 
school I 

Student says he hatles 
scljooj. j 

sWdent is a member! of 
school xlub or spores team 




^ t- statistics in! parentheses • 

* = significant at the •OS percent leVel^ 
** = signifieanfi at the •Ol percent levels 
*** = significantj at the .001 percent leyel. 
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(Part B)* In several oi the ^aalyses the presence of the program is 
as^iociated with more fa.yoral^le student attitudes of seve il kinds. In 
parti^ilar, it is associated with an increased probabilri-ty- students will 
say they\would prefer a racially mixed school over a segregated one.,^ 
This is encouraging for two reasons. First, this type of student out- 
come might be expected to change as a result of altered teacher atti- 
'tudes. Further, student attitudes that would not be predicted to 

respond to changes in teachers are found to have no association with 
-^he presence of tjiis kind of program. For example, this type of in- * 
service training does not 'appear to make any difference to how much 
students like to go to school. Second, ehis is precisely the kind of. 
program that reflect,€id ESAP's'goal ^ achieving successful desegregation. 
Moreover, inservice training that has a different kind of emphasis, 
teaching methods (Part C) , does' not have the same effect on student 
attitudes. Xhi^ .too falls' in line with expectations. Programs that 
set' out to alter teachers' attitudes ajld behavior apparently succeed 
in changing the way, students feel Q^ao^t things too. ' - . 

'Hpst 'of the positive and" significant results in Part B are concen- 
trated among white students of both sexes. This suggests that black 
and white students respond in different ways to their educational, en- 
vironments. But it also suggests that these program effects on non- 
cognitive outcomes are not going to account for the^el-ationship be- 
tween ESAP and the educational performance of black males'. If blacks 
are not affected by these kinds of interventions, then there seems 
little hope of sk&tching the connection of events between the ESAP . 
7 funding on the one hand and the higher test scores of black students 
on* the o'jther. <i 

More positive program effects are found in Part D, which reports 
— the—efferrts-Di^rograms i-n intergr.oup relations' designed for^ students. 
Here too the positive and statistically significan^t ^results outweigh^ 
the number that would be expected by chance by a large factor. And 
again, this kind of activity is associated with the differences in 
attitude that might be expected. For^ instance, it is associated with^ . 
a larger proportion, of students who say they prefer integrated over 

segregated schools and with a larger proportion of students (white^only) 
*. * 
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who interact with students of the other race. However, the program 
has little effect on students' perceptions of teachers' attitudes, or 
on the extent to which students like going to school* This to'o^is 
^^encouraging since once again it is the type of program that ESAP ^fostered 
and its effect is consistent with ESAP's goals^ However,, it is- worth 
noting that the program effect is least obvious for black males, so it\ 
does not look as \if this kind of educational activity could account for 
ESAP's success with black males. 

Parts E and F deal with programs in minority history or culture and 
those designed to bring a closer relationship between parents and school. 
Courses oriented to minorities do not seem to make , any difference to 
students' self-esteem, even black students' self-eslteem, nor does it 
alter attitudes about going to school;, though, for reasons that are not 
immediately "obvious, it does have a consistent; effect on the interactions 
among students of different races.* Since this program did not alter' 
students' outcomes to any s||t),stantial extent, and cer^tainly not in the 
way that was expected, it does not look like a promising tcfpic for further 
analysis. The same general conclusion holds for the .analysis of programs 
that develop parent-teacher relations (PartV).' The effect of this , pro- 
gram is uneven, except that It is associated with higher levels of self- 
esteem among students. However, compared with insetvice training in 
race relations and interg-roup programs for students,' th^ effects seem ^ 
modest. 

In review, the strongest evidence o^ special program effects were 
obtained in the analysis of inservice training programs that emphasized 
race relations and programs that develop intergroup relations among 
students. "The analysis of these two program variables was extended, 
first by looking at the possible confounding effect of recency of de- 
segregation. In the analysis of teacher outcomes -it was pointed'out 
that recently desegregated schools were more likely to have this kind 
of inservice training. The question was whether this difference might 
explain the levels of student attitudes regardless of program presence. 
In other words', was the program effect apparent rather than real? The 
regression analyses for these two program type variables (Parts B and -D) 
were repeated with extra control variables added that grouped schools 
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according to'the'^recency of desegregation* "The results clearly show ^ 
•that recency of desegregation does not substantially alter the un- 
controlled relationship between program type and student attitjude* 

• The second step was'to investigate further dependent variables. 
New measures of self-reported behavior and attitude were used in 
Ta^le 6, ^followirig leads from Table 5. These analyses confirmed the 
previous finding; the positive effects of these two programs tend to 
be concentrated among white students. Thus inservice training that . 
emphasizes race relations has,^ positive effect on white student's 
interaction wtth blacks anii.?-cax their attitudes to black students/ but 
there are no corresponding /program effects on black students. 'This 
is important because previous analysis had shown- that two of these 
racial attitude variables might explain* the relative performance of 
black males in experimental schools, Th^ qjyiestlon is \^hether the • , 
attitude variables nfight be influenced by the^esence of cerfain kinds 
of education programs "It is clear that they are not so related; black 
students' racial stereotyjfing and their belief about the relationship 
between race and intelligence are not to b^ explained. by this particu- 
lar kind of teacher training. 

As before, this kind of inservice training is associated with more 
favorable perceptions of teachers' attitudes and^behavior,. just what 
might be expected to result from a program like this. But again, the 
program does not have the^ safme effect on blacks. 

The analysis of programs in intergroup relations, for studen<ts 
(Part B) shows comparable results, though less obvious^. Most of the - 
positive effects are concentrated among white students as before, but 
some of the statistically significant relationships are found ,for the 
two black groups. Thus, this program too ^s associated with more 
favorable attitudes toward students of the other race arid higher levels 
of interaction between races. However, the' effect on perception of 
teacher'' attitudes and ^ehavior is mixed; in most- analyses .the relation- 
ship is negative. * 

In summary, the p^jttern of results accumulated over a substantial 
number of analyses indirates two programs were associated with more 
favorablCjiStudcnt attiftudes and behavior, though this effect is almost 
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■ ' ■ Table 6 . 

RELATIONSHIP BETWEEN PROGRAM TYPE VARIABLE AND MEASURES 
OF STUDENT NONCOGNITIVE OUTCOME, BY- RACE AND SEX ' 



' , - " Black Black * White White 

Dependent Variables . Males Females Males Females ^ 

Part A: Inservioe Training with Emphasis on Inter£foup^ Relations 

Would like more friends of • , * aaa 

the other racial group -.02, .04 • .10 .08 

(3-83) (3.10) 



V 



Feels uncomfortable with 
students of the other race 

(Range 1-4 • 4=never) • -*03 " ' -.01 .00 . .01 

*> * 

Says three students talks to ' * * * 

most are ,of the same race '* ' 

(Range 1-2. 2=no) . -.05 -.07 . .08 .09 . 

(2-93)^ (3.51) 

Had helped student of other ^ . ' * ' . '* 

race with homework -.03 -.05 ..04 .06 

- : ^ (2.44) 

/ ' ' ' 
Had asked for' help with home- 
work from student of other ^ 
'race ' ' -0^ -.05 -06 - ^ .08 - 

(2.37) (3.18) 

Describes students of the - ' 

other race as dumb (l=yes/ ■ * * 

2=no) ; -04 -.04 • .06 . .06 

' • ' (2.07) (2.12) 

Says color doesn't have- any- 
thing to do with smartness ^ /) > a 
(l=agVee/0=other response) -.01 • ' -.01 .05 , .05 

\ ? (2.02) ' 

Principals seen as liking 

blacks and whites at same , ' "\ * . *** 



school, by student ' ."07 .'OX .00 .13 

.^(5.05)- 



Teachers seen as being unfair ' ' - 

to whites (Range 1-2. 2=no) .05 -.02 -.02 ^ -.03 



Table 6 — continued ** . * 



Black • • Blaclc - Wljit^^-^^'Wh^is' ' '' * 
Dependent Varrlables -— "MSTes Females*^ Males XiX F^tn^^a--; " 

■ — ' " " ff'f. .' " 

t^rt A: Inserviae Training with Emphasis on Ihtergfoup Relatio^ }(continued) 

.'Teachers seen as being unfair ' 
to^lacks (RangeM-2. .,2=no)„ -.02 .02 .01 --02 

Teachers perceiyed as ''liking ^ ^ 
•blacks and whites going to * ^ 

§ame schoal ^ ' ' * 

(l=yes/0=other) / .10 . .00 . .05 -09 

\ . (2.87)"^ . ' (3?52) 



Teachers perceived as dls- 
lil'ing blacks and whites 

going to same school - ieidt 

•CO^s/l-other.) .06 - .08 .08 * .13 



ki 

h.55) C2.97) (5.01) 



Part R: Ana-lysis of Programs^ in Int^r^roMp Relations among Students 

•Would like more, friends of '^^ - 

the other racial ^roup -.04. -.00 . .08 .07 

^ OaS) / (2.63) ^ 

Feels uncomfortable with . ' ' .' 

'Students of the other race . v ' 

(Range l-A. 4=never) • -.06 , .08 , .01 ' .02 

(2.55) • / " 

3ays three students talks to ' , * • 

most are of the same, race i^cif 

(Range 1-2. 2-no) '\ -.03 ' v. 02^ .09 ..06 

V < . ' (3.^7) (2.27) 

Has helped student of other 

race with .homework - -.04 .11 .05 .07* 



(3.93) . ' (2.76) 



Has asked for help with Home-- ^ 

work Prom stucient of other " ** 

.08 .08 .02 .08 * 

I : , (2.70) » ' (2.98) 



race 



Describes students of the > 

other race as dumb (l=yes/ " ^ ' ' ^ . 

2=no) ' .03 / .02 . .00 .07 



Table 6 — continued 



Black Blaclic White White 

' • ' ' Males * Females Males 'Females 
Dependent Variables • ] 

'I 

Part B: Analysis of Programs jfi. Intergroup Relations among Students .(cov\,tivtued) 
* » . # • " • 

Say^ color doeSn,'t have any- ' * , 

thing to do with smartness ^ # % 

(l«agree/0=other response) .00* .Oh .05 .08' 

, , . ' . (3.35). . 

, V 

Principals seen as liking ^ . 

blacks and whites at same * * « 

school, by student .02 » .07 -.02 -\ -.01 

' (2.24.1 



4c 4r 



Teachers seen as being unfair » 

to whiter (Range 1-2% 2=ho) - -.lO"" -.02 -.05 , -*04 

• (2.9B) 

Teachers-.se^ 'as being unfair • . ' ** ' ■ ' 

to blacks (Range 1-2. 2=no) -.08 .00 -.08 „ -.01 

(2.20) t ' .(2..99) 

Teachers perceived as l^iking * . ' ' . 
bfacks afnd whites going to ^ ' "^"^ * . " . 

same school (J=yes/O=oth^r). . \02 " /66 . . .03 .01 



(1\98) ♦ 

Teachefs^perceived aa dis- ► > . ^ 

Hieing blacks-^ and whites. ^ . * ^ 

'going to sgme- srchoob ' ^ ^ < -k-k-k^ 

(O=yes/l=other) , ^ r.Ol ..13 ^ .03 * .09. 

- (A. 31) . , (3.68); 



t- statistics in parentheses . 

* = signif;icant at. the .p5 percent lev^l. 
**. = significant at the .01 percent .level. 
.*^c* = significant at the .001 percent level. 



entirely concentrated among white' students* . To repeat, these results 

^ are encouraging, but they shoaJd not be blown out of .proportion. They 

— ao not tell, us how ESAF worked; they only report on the, observed* re- 

lationshlps between program types and certain teacher and student out- 

comes in the experimental and control schools.' Nor are th^se efTects 

large ones. The pattern of results supports a positive concl^usion, 

but it would be incautious to make *bold predictions about the Amount 

. * • \ 

of difference that could be brought about by wilder application of, 
these programs. This is Rarticul^fly^ue^'^^ we have only the mqst 
^general idea "of what *t he programs cons^lrst ^ in the first place; they \ 
ljizf:M!^ld therefore be' difficult to repro(^uce, .^ltht)ugh some attempts have 
beertv'm^de to test alternative explanations of t^e findings, such sta- 
tistical devices can never be exhaustive, by 'definition. Therefore, 
there -1^ the fever-present possibility rti^t the observed effects are 
not properly attributed to the -programs, but to some untneasured or un- 

controlle(Kthira-^4^«eTTCigt"^Despite these c^tftions, the results are' 
\ * 

suggestive oKways in which schools, alter teacher and student* attitudes 

'and the leads provided these analyses direct the approach adopt^ed in 

\ * \ * 

— the following section, which looks^ again at the determinants of achieve 

1 / ' ' ... \ ' ' • 

ment levels. 
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VII, THE*RELATION 0^ STUDENT ACHIEVEMENT TO ESAP , 
^DlfCATIONAL PROGRAMS, AND. .STUDENT ATTITUDES 

The first *i)art of the Rand work with the ESAP data consisted of a 
• ♦ ~ 

reevaluation of the program*s effects on<^student achievement by various 

comparisons between experimental andi control schqols, ;In this'section 

the analysis of achievement scores is taken in two different ditectiqns, * 

Fifst, I look at "districts , where students in the ESAP school did much 

better than those in the control school. These instances, caJtled out- 

liers, are -examined for posstlj'le cluiss about special or unusual circum- 

» *^ * ' ' 

stances associated with program success. The districts where experi- 

' V . ' : 

mental school students far outperform those in control schools are 

compared -with districts v?herd the reverse is true. The purpose is to, 

identify dramatic differences between highly^eff Active afid "ineffective 

implementations of the Emergency School Assistance Program, gince there 

a-pe 48 school'-pairs to stdrt with^ and I am looking at only a fraction . 

of these, this part of the analysis approaches case study ^.^-^^ 

The rest of tHfe section is^not a study of ESAP^ peruse, but of the 

relationship between school programs and student achievement. The ob-^^ 

jective here is to tie together various parts of the reanalysis. ^^C^r- 

tain educational 'programs ^have been shown to be associated with favoy- - 

able noncognitive teacher and student outcomesT"and some of^ttiH^e, in * 

turn, have l^een found to be related to stUdent achievement^ The analysis 

* reported here aims at relating programs, nohcognitivia. variables, and 

achievgjien^^-n an. effort to explain performance levels with the avail- 

'•able data oh' schools, teachers , -and students. 

* , • y 

ANALYSIS 'OF OUTLIERS ' ^ 

The first- task is to define the outlying districts: • those where 
, students in experimental schools did either much better or much worse 
than those in control schools. The sample was divided into th^ foyr ^ 
race-sex groups because the purpose of the analysis was to examine , ; 
interactions related to -these two variables. Then, a school-pair was*" 
eliminated where there were fewer "than four students oi a given race or 



sejtf." This meant different schcTol-palrs were eliminat^ ftom the/four 
subgroiips. The next series of choices concerned the measure .of efiec- 
tiveness. In -the end. the Amplest was used: the unadjusted difference 
.between the means for experimental and control school students .^_An ex- 
ten^sive examination of adjusted difference scores revealed that the ^ 
same schools were located ih *the upper and lower ends of these di^stribu- 
tions as'were in the two ta»ils of the distributions of unadjusted dif- 
ferences. The. four distributions are displayed in Fig. 1. • ^ 

f Straightf orwaifed examination sti^ests that there are all kinds of 
departures from norinalityi but-4ef initive judgments are hard or impos- 
sible because of the small number of cases. The cases at the extremes 
of the distributions coiild well b^ manifestations of a lo!w density' 
spread* of consideraljfle importance. ,ln hope of bringing these unusual 
properties to light jl reconstructed them using grouped rScther than con- 
tinuous cjata (Fig: 2,). These two representations of t.he distributions 
sugge^{ several things. First, there are outMers at both ends for white 
males, and possibly positive outliers for white f^emales. In addition, 
these distributions appear to .have two modes. The distribution for black 
females piles up at the left hand side; only the distrix^jution for black ^ 
males seems roughly normal. \ 

The next step was to decide on a cutoff point tox the 3'^finition 

of outliers. This necessarily involves judgment, . one consideration. 

* 'it 

bei*rig that a cutoff \6o far from the mean i,s going to yield a very small ^ 
number- of cases. Guided by this practical consideration, I set a limit 
such that about 10 percent of tha. cages would be identified as either 
positive or negative outliers^ for a^given distribution.* Cases over 
K5 standard, deviations above the mean for each distribution were char- 
acterized as 'instances of highly effective ESAP treatments and cases 
i;5 standard deviations below the^mean-^ as instances 'of -btghly^-ef^ective 
control schools. In^ a normal distribution these limits would separate* 
'13. A' percent of the sample. These limits are marketl 'Fig; 1 and dis- 
tricts above and below the cutoffs labeled by their serial number. Eight 
cases fall In the -low end of the distributlolfi, seven in the high end. 
Counting eadh appearance in the outlying group separately, there are an 
average of just untier five cases in each distribution' in the high or low 
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category, almoit exactly 10 'percent of the total number; of school pairs, 

/ < ' » 

This is sligh/tly under'-the expected fraction of the distribution. Four 

/ * 
districts appear in more than one distribution, implying that where a . 

•'district is/highly ^ffective~or ineffective—for one subgroup of stu- 
^ents it m^y also^be effective— or hot— for another* However, if these 
four distributions 'were totalJ.y independent of one another, some of this 
consistency would b^e expected by chance. In fact, the number of schools 
observed' in more th^ one distributi|ln is below that expected for four 
independent^distr.lbutions . 

'*t/ics main question Is whether these outlying cases can be differen- 
tiatejtl ffoin one another, . If' they can, it might suggest reasons for the 

' unusual success or failure of ESAP. To .stprt With, comparisons were 
madc""1>etween high and low outliers on a number of school characteristics 
such -as , the size, the percent olf white students, the recency of desegre- 
ga^tion,* the attitude of the principal- to desegregation, tke per pupil 
expenditace, and so forth. All available indices ♦of school- to-schoorl 
differences were used. Very few showed >high and ibu outliers *ere • 1^ 
cjLearly different from one another. Tbe exception is that positive < \ 
outliers tend tc) be smaller than negative out'Jliers (a difference of over 
Ipd jiJtuVients) , and they tend to ,be located in| somewhat rural areas (esr 
tabiished using the percent of people in the .county living In communiti^e^ , \ 

^.of over 2T500). High- outlying districts ftad fewer scliools, (21) than low \ 

' * I \ ' *^ 

outjlers (28) and fewer students in all (abodt 11,000 and 15;, 000). 

I^e^e differences are not statistically (significant but they may not- 
* be for/tuipous either. There arc several rpfeons for thinking^ a program 
like ESAP Would be more succesaf^ul in small* school (jListrict^ and small 
schools. ^For 'bxample, these districts may be more . manageable so that 
excra federal fundus do not get lost. Administrators might'be more care-. _ 
ful to see the moneKgets used for the right purpose. ^Another possibil- . 
ity is that rural schob^^distri^ts a.re more .peaceful than urban ones and * 
therefore provide a more s^t;able setting in which, innovations can be . 
Innlerftented. Or, the familj^ students come from may be more homogeneous" 
in rur.^l areas, and this may mean^.bhere^re fewer cross-pressures to con- 
tend wich when changes take place i\schools. * . 
/t. vSomf. of these issues can be pursuit} with the data. For example, 

• 82 ' - • ■ ' . 



principals' ireports on the level of disruption of the school can be 
used to' check. the idea that smaller, rural -school districts are more ^ 
peaceful places. - One of thesfi measures (frequency- with which students 
lockers are broken into), showed the expected difference, but the sam^ 
pattern of results was not f Dund consistently for tlie other variables. 
Another index, of disruption, absenteeism rate, also showed high outliLers 
were better off than low outlliers. So, -taking a selective approach jto 
the data, the case can be mide that the low outliers, where control \ 
school studenits did better jkhan experimental school students, were more 
disorganized places, bf course, this does /lot prove that; disorganiza- 
tion led to poor educational performance; the evidence does not warrant 



such a strong conclusion. 

/ ' ^ f ' - ' 

The other. suggestions^ were even harder to test adequately. There 
was no sensible measure^of how readily these schools can be controlled, 
ei«:her b'y the administration or by thd principal. " The closest approxi- 
mations were the principals' assessment, of how much effe<^t they can ^ 
have on students, and information about the 'superintendents V actior) in 
helping ^sch(;iols with the process of desegregation. Obviously, neither 
can be taken seriously a^ a measure of subtly and complicated realities. 

The. next question is whether , the, high and -low outliers can be dif- 
ferentiated in terms- of educational programs and activities. For 
example, are t'he' high outliers more likely to have remedial education- 
programs? The simplest possibility is that the low outliers were dis- 
tricts where the experimental, design had been vitiated. That is, ESAP 
jnight not. have been delivered to the experimental school, or it might 



have been delivered ta the control school. Of the eight low outliers, 
there was only otxo district where the c^ontrol school had received ESAP 
funding. This explanation ^does not seem terribly] helpful, therefore, 
since one of these six deviant cases^>ould be expected to 'show up in 
the lower outlier group on probabilistic grounds'. 

— TStiilT^he low outliers might be those districts that received a ^ 
smaller ESAP grant (in the experimer al school) than the high outliers. 
However , comparison of the two groups showed that the low outliers' 
actually received slightly larger ESAP grants. This could be explained 

' by the fact* that tl.ese schools tended to be larger; when the ESAP grant 
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was expressed ad a fraction of'. the total school budget the difference 



between high ahd low groups disappeared. -Consistent\ with jthi:S--prttern, 
the low Qutlaers were ^^aund to have larger numberp oA programs and 
activities' as reported! by the ESAP director or princiii^l. But this too 



could be explained largely in terms\of the differjence size of ^he 
two types oF schools. iWhen these tallies or the pumberVof prolgrams 
were adjbsted for. school size, thg' di^f erences beitw^en- .tke.two groups 
either vanished or were Iredu^red with one excepticjn. A cumulative score 
for ESAP-funded activitijes indicated by the direcjt/jr shows\high outliers 
had more activities even^when the size of sc!}Ooljhad been t^aken into 



ciccount . 



While this makes good sense, .and. is (encouraging, -J:here is, a danger 

of taking crude cumulativ^' s.cores 'too *terally.| Equating 'prbgrams of 

di/ferent kinds, as one dqes in making^a simple icumulative sc^i^B^^^^ • 

>viously a Jiazardous /assumption/ And no accou|it is- taken of i^he dif- 

^ferences i n siz e or /und ipg of these activities/* _Thus a school^ that 

spends all its money on a remedi'al education program will have a '^lower" 

* K ' ' . ^ \ - - 

scbr-e-H:han one that decidfes to dot/^.ive different things .with the\ grant, 

/ ' ' » ^ I " 

■Nevertheless, t^vis finding suggested a close iinspectlou of the ESAP- 

:fundjexi'^ programs in thesd schools to see if there were particular Istrat^ 

sue 



legies associated witli sufccess or failure. Accordingly, the two groups 
-were compared for differences in the things that ESAP- money had bought. 
I'ln general, no pattern emerged from this' analysis. The high outli^ers 
* were neither more nor less likely to have used money on remedial ojr 
' tutoring programs. .They did not concentrate money,, any more than 
other ^roup, on inservice training. Nor did; they use it on-special 
kinds of inservice training", such as training in race relations. There 
are- no special resources or equipment found in the high and low grc|ups. 
And it does not seem that extrp. personnel, such as teachers' aides,| are 
moire common in the successful schools. Nevertheless, even though high 
and low outliers do not seem to have distitictiv^e types of programs, on 

i 

one .cnmulative measure t^e high outliers turn out to be better supplied 
by. ESAP. / ^ ^ j 

^ To summarize, tJie hi'gh and low outlier ^groups ate different fr(|m 
one another, but not in terms of" the kinds of educational programs tjhat 
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they have* They are different in terms of location and size; low out- 
liers, tend to be larger and located in urban areas. This may hint at, 
the Importance of the setting for ESAP rather than the substance of the 
program itself. Thfe key to success may'^not be the content of the pro- 
gram so much as the way in which the .program is implemented. This idea 
fits with the tact that ESAP regulations allowed school districts a good 
deal of latitude in devising their version of ESAP. It might be expected 
therefore, that the skill with which, local administrators adapt ESAP to 
their local needs would jnake e difference to the outcome of the program. 
I5u.t this -is a guess! ' ^ 

< 

EDUCATION AL PROGRAMS. NeNCOGNITIVE OUTCOMES. AND STUDENT ACfHIEVEMENT 

Earlier in this section I. looked at unusually effective and ineffec- 
tive instances of ESAP. Here I look at all the dat^^n an 'attempt to ex- 
plain variations in achievement by, differences in educational programs 
and variations in students' attitudes. There are two parts to the analy- 
sis. 

(1) ^ ESAP was shown to have an effect on certain, measures of stu- ' 
dents' attitudes; that is, students in Experimental schools had more, oc 
less favorable attitudes than those in control schools. But these *ef- 
fects were more evident for white students than for blacks.- If the pro- 
gram had an effect at all, it would seem that the white s tudents^'were 
the- ones affected. Most puzzling, the effect on whites was positive for 
males and negative for finales. 

Since ESAP had littlo effect on these noncognitive outcome.s for 
black males, they did not look like promising intervening variables .to 
explain the linkage between program funding and achievement scores . 
However, it is possible that the program affected black male achievement 
levels bychanging white students' attitudes. The program could have 
ther:eby created a less threatening environment .for black male students 
so that they felt better about their sch.ool work and performed more ef- 
fectively on tests. This assumes that white students' attitudes are an 
important ingredient in determining the quality of black male students' 
experience in school.- For example, ESAP was- associated with more posi- 
tive attitudes for white males in the way they f^elt about desegregated 
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schools and in the degree whicii they , interacted with black.students. 
Perhaps tiiese changes made "it easier for black males ta feel accepted, 
to feel*lesj; threatened, and consequently to Improve their potential 
for educational 'performance In school* A complicat'ioh enters at this 
point because while ESAP .was associated with more' favorable attitudes' » 
for white females on some of the measures examined in Table 2, most 
showed a reverse effect: Control students scored above experimental 
students. \The aggregate measures of these latter variables' would be 
♦expected t'O have a negative association with bj[a^k male achievement; 
at least that would be consistent with the view ttiat students' infl-uence 
on one another's attitudes is not dependent on sex. • . 

Aggrega'te scores were 'computed for white males and females sepa- 
rately, so that each school had an ^aggregate score on those noncognitj^ve 
•oatcojnes that was significantly associated with .the presence of the pro- 
gram. These aggregate scores could then be^co^elate^ with the individ^ 
ual level achievement test scores for black males.' -Tabl^ 7' reports 
these correlations (first column). Even with the' large number, of cases 
i-nvolved, only one is statistically significant." However, there is^'some'' 
support for the idea of aggregate effects in the pa^Jtern^^of-ai^tts of ^ 
tliese correlations. With a single exception, the correlations fiall in 
line with expectations* Where ESAFJ^ is associated with a positi\ie ef- 
fect on student attitudes (all the white male attitudes »and two of. the 
white female variables) the cbrrelations reported in Table 7 are posi'-r 
tive. "where ESAP is associated with a negative effect *on student ^|tti~ 
tudes (aU but twd of the white female variables) the correlati^^yfis are 
negative. Taking the analysis one step further, .a measure of student's 
social background was. introduced, - The suspicion wa^ that this might 
substantially change the uncontrolled relationships reported in the first 
column of Table 7. .The partial regression coefficients (achievement, 
dependent' variable, independent variable indicated in left hand^margin, 
mother's education controlled) are reported in the second calumn. Though 
it is true that in three cases tlie signs of the correlations are changed, 
in general the introduction of this control did not alter the* conclusion 
derived from the fifs't set of t;esults. The zero order relationship is * 
not to be explained away in terms^ of student social background. 
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Table 7 . \" > 

RELATION BETWEEN AGGREGATE MEASURES OF WHITE STUDENT 
ATTITUDES AND BLACK MALE ACHIEVEMENT 



4C 



7 5 ^ 

Aggregate. Measures for White Males * • ^ ji^ ^ ^ 

If student had talked to counselor 

during the year ^ •013 -"♦007 

Student would prefer to attend a' 

racially mixed school ^ •.019 -.007 

< 

Student, would like more friends of ; 

the other race . . ' '•060 ' .047 

Student had helped another of the . ^ ^ 

other race with homework .'-.007 ' -.016 

Student ^had. asked another bf the other ^ • . 

race for^help with own homework .041 .040 



Aggregate Measures for White Females 



If student had talked to "counseldr ' • 

during the year , - •OlS • -.001 

Student says slie is glad to go, to 

school in the morning . -.026 ^ 




Student says that when punished it 
is^for no good reason -.029* "-.038 

Student thinks principal's attitude • ^ 

to desegregation is favorable -.051 -.052 

Teachers s^een as being unfair to 

white students^ ' -.042 * * -.018 

White students reported as cbmplaining 

of favoritism on 'part of teacher^ -.067 -.055" 

♦ 

Black students reportecl as complaining ^ 

of favoritism on part of teachers - -.099 -.u92-» 



Column 1 . Zero order correlations between aggregate measures of. 
white student attitudes and Individual black male achievement scopes. 
Aggregate' measures of white students' at. itudes -are those for which a 
• statistically slgnif i.C£^nt difference exists between experimental and 
control school students (see Table 2). 

Column 2 . Standardized regression coefficient for m'easure of ' ^ ^ - 
white student atM.tude wlthomofherjs education controlled,' 
• ^' > \ * = significant at- the .05 percent level.. • ' . 
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^^.^It must be remembered that the correlations are not large; they 

'account for a vanishingly small percentage of the variance* in achieve- ' 

ment*** In a separate multiple regression all five white male attitude 

variables were entered as independent variables and were found to . [ 

account ftjr an additional 0.5 percent of the variance in achievement- 

« 

over and above that explained by mothe;r's education. The comparable 
analysis ^^0x^40^ v^itf female attitude variables had similar results; ^ 
an additional 1.3 percent of the- variance in achievement can be attrib- 
uted to the variation in the complete set of independent variables. 
These "results must *be considered in light of the fact that only a small ^ 
percentage of the variance in achievement (under 1 percent) can be 
accounted for by ESAP. ' Therefore .any intervening effects are ^ing to 
tiiive to be smaller still. Seen this way, such tiny effects become more ^ 
important. • . - 

(2) The analyses presented in the second part of Section|VI showed* 
that certain prograpis were associated with differences in noncognitlve 
student outcomes,. Specifically, Lnservice training for teachers that 
emphasized race relations anctj ptograms th§t helped intergroup relations 
among students were associate^ with more favorable student attitudes an4 
more positive self-reported behavior. However these effects were again** 
.conc^cntrated among white students, so it did nat^ se^em likely that the • 
key to explaining .the program effect on black male achievement would be - 
' found here. Nevertheless, the inquiry was.^pursued, broadening the'ob- 
jiictive to include all four subgroups of stud.ents in a getleral Inyesti- ^ 
gat ion of the relations amor^ program type, noncognitlve out,co\ne, and 
student achievement score. . • * 

Table 8 reports the analysis of ^ the two program type variables, 
inserVice training focused on race reJ.ations and 'intergroqp programs 
for students. ' The four race-sex groups were analyzed separately for • 
two r^asoifis; the relationship between noncognitlve outcome and student 
achievement had been found to vary ^i^cross these four groups, and the 
effect of thesir-two educational programs on the noncognitlve outcomes 
had also b.een shown, to differ ""depending on student race and sex.^ Sev- 
eral noncognitlve variables a/e chosen for the analyses,^ the c-haice 
. being based on results obtained in Sections IV and VI. Is the 
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Table 8\- * . 

ANALYSIS OF RELATION BETWEEN, PROGRAM TYPE , SELECTED 
STUDENT NONCOGNITIVE VARIABL^? AND STUDENT 
ACHIEVEMENT SCORES, BY -RACE- SEX GRQJJP 



\ 



Intervening Variable 



Black. 
Males 



BlackX. 
Females i 



White 
Males 



White ' 
Females 



Part 



A: Program Type.: - Inserviae Training with Emphasis, on ,Raoe Relations 



If student had talked to 
a student of Che other 
race on Jthe. phone 



If student could choose, 
he would prefer a 
racLal>y mixed school 



^ school club or sports 
team ' 1^ 



Student would like mor€i 
friends of 'the opposite 
race 



Studcnt'had asked for 
help \JT^ai^\rm^'tVrip:om 
student of other ra^c 



Part B: Progrojn Type: 

Student's rating of his 
abi-fity compared with ^ 
others in his class 



Student had called a 
studenL\of the other race 
on the phone 



r 




.07 


D X 


03 


.07 






• \J\J 


R^ •* 
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r 






- b-1 
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.17 ■ 
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. . .09 


if r 


.07 " 


.15 
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. .14 
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,.12 
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.05 


.07 








r . 
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.08 


b-1 • 


.08 


.07 


b-2 


..09 


• .08 


• r2 


.05. 


.07 
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•.08 


. .J5 


b-1 


^08 


.06 


b-2 


■ --.07 ^ 


-.05 


■ r2 . 


,■=-..05 


.06 




i.- „ 




Programs > 


in Intergroup He! 


> 

r 


.32 


.39 


- ' b-1 - 


.32 


.39 


b-2 


..30 


.37 


r2 


.14 • 


..19 


r 


.03 


;07 




b-1 
b-2 
r2 



.03/ 

.02 

.05. 



.07 
.05 
-.06 



,15 


, ; .24\ 


.1-5 


.25 


.12 


! .20 


.07 


. • .1?^ 


.19 


• .08 


.18 


.08 


.17 


.06 


.09 


.12 


.08 


° -.02' 


.0'8 


-.02 


.08 


-.02 


.0'7 


.11 


for 


Students " 


.46 


.45 


.47 


.45 


.43 


■ . .39 


;24 


-25 






. .09 


.08 


.10 


• ' .08 


.07 


.05 


.06 


,.11 

♦ 
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■ ' - 'Table 8-:-continued ' 



: • «> 

Black Brack White White ^ , ^ 

Intervening Variable^ ' "Malgs Females Males ^ Females. 

Part B: Pvojvam Tyixe: Programs- in Int'ergvoup Relations for Students (^c;ontinued) 



If- student could choose, 


r' 




.19 


.19- . , 


.15 


would go to a racially 


b-1 


.15 


.19 


.19 


.16. 


mlxed^ school 


b-2 


.'14 


.17 


; .17 


.12 




. r2 


.07 


.09 


-.09 


-.13 


Student is member of 


■ r 


.07 - 


M5 


115 ■ 


.24 


school club or team 


b-1 


■..07 .. 


.14' 


.15 


■ .24 


• 




.05 ' 


.12 


- .12 


■ .i9 


a 


r2 ■ 


.05 




.07' 


.15 ■ 


t 

Student would like more 




.08 


.08 


0 

.19 


.08 


friends of the opposite 


b-1 


.08 


.08 


.19 


-.09 


race 




.09 - 


.08 




.07," 






.06 


.06 


.0? V 


.12 



Notef Table reports zero *qrder correlation between noncognitive variable 
(indicated in 'left-hand margin) and achievement, the standardized 
par.tial regression coefficient for this relationship when program 
type Is introduced into the equatlou (b-1), the same coeffrcient 
when mother's education, is also entered ^in the equation, and the 
value of r2' when all these variables are inclHded in^the equati-on". 
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association between student attitude and pertormaace to be accounted 

• for by the presence of ei#ther of these two , educational programs? 

*Table 8 contains four pieces of information. First, it shows separately, 
by subgroup and by noncognitive variable, the direct 'ifelatlonship (zero 

• order^correlation) between achievement agd the noncognitive variable. 

iBelow this is the standardized regression coefficient for the noncogni- 
tive variable obtained when th^ dumir^ variable videntifylng program -tsypc 
is also entered in the equation. Underneath th^t is another estimate 
of the. same relationship, also a standardized regression coefficient, 
when^' mo'Sher 's education is entered<,as an additional control. The fourth 

pieci^ of irfformation is the value of R" for the^ whole equation. 

* * " • 

Neither of tliese two programs explains the direct relation between 

e noncognitive variable and^ achr^evement . This can 'be s6en by 'comparing 

the first number (r) in each ceU with the second (b-1) . Although to 

varying* extents students' educational* performance can be attributed ' to 

„ . \y , 

their noncognitive differences, no case can "be made thatThese reTation- 
ships are due to -the presence or absence of the most promising pro-am 
, types identified by previous analysis! The- effect bn the partial rela-^ 
tionship of introducing the , control for social background is a good A 
deal more pronounced t^;an the effect: of intfodujirig program type as the 
intervening variable . (r compared with b-2 in edch cel^) . The control, . 
tot social bacTcground takes account' of ^the'^degree tj? which these kinds 
^of educational programs are located in schools with students of^^differ- 
^eht levels of ' educational perfoj-tnahc'e, » and it also tak^s accouht' of the 
relationship between background and achievement. Social background 
appears to be a good deal more important in accounting fo* the' r^lati'or- ? 
"ships .between the noncognitive varjlables and achievement than 'are the 
measures of program type. ^ ' . y ' 

in summary, these two ptograms appe»r*|to be associated with posi- 

• ^ 0 ' > ♦ y 

tuve and desirable ^outcomes, which are consistent with the general aims ^ 
ana intentions of ESAP: , inservice trainlrg programs with emphasis on 
Intergroup relations and programs In inteifgroup relations for students. 
However, -aJfthowgh the changes « these programs brought about In sbiMents 
are associatiid^with their fed^ucational performance, there is ^little basis 
or aitributing that assbciation to the program type. Therefore, these'- • 
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/• • two. programs migl\t be judged in terms of their effects on certain non- 
^* ■ cognitive outcomes, but they do not appear to provide the explanation 
T of .the higher achievement levels of any one of t'he four subgroups of 

students, including black male 10th ^graders. Of course, It shouW^-. 

remembered _these 'progranfs are not necessarily ESA.P-funded . ^ 
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VIII* REVIEW. 



.la-p^eviewfrtg 'the arialrysis I put aside the' quaiiFications and 



caveats scattered thtough the text, -but "I do so knowing ^^ shortened 
'summary is vulnerable to misinterpretation. The review/ should be 
seen as the most positive and^ optimistic rendition of jzhe results. A 
mote. cautious account will be found in the text,' and tHe reader is 
directed there also for information about the oize of^the effe^its - 
being discussed. « * ' , 

(1) Although ESAP does not alter the racial climate of the school 
in general, it does change the attitudes and behaviors of some groups* 
of studen|:s, notably white males and black females,- In- a positive 
direction. These students are 'more likely to feel they belong in . ^ 
school, are happier about going there in the morning, interact more 
with students oi the other rac^, and would prefer., a racially mixed 
school. These are the kinds of dispositions and attitudes thaV^SAP 
^tried to develop and can. be seen either as ends in tjjemselve.s or as 

means to the end bf arhievtmg-successf ul desegregation. 

tf * * 

(2) ^Measures of .students' attitudes and behavior are ass6ciated 
^Vith their achievement levels, a*nd thes? relationships are stronger or 
.weaker depending on. the student's race and sex. There is no sitople ^ 
summary of all these differences, but achievement is somewhat related, 
to Whether the' bj^^csk student ^hi4iks^' race is linked to IQ^and thinks 
other Macks are^smart. This is suggestive of* the importance of serf- 
image in academic success. Unfortunately, ESAP doe? not appear to have 
been responsible i^r changing b]ack student si. attitudes in this key , 

area> \ • ' - 

(3) '* A good .deai of ESAP activity wasi devoted to improving inter- 
group reTat^onsK'i^s,' Jpoth among teachers and among students. Signifi- 
c^ntly, both kinds of programs are. associated with more favj^nable 
.attitudes afid\behavio,r- in schools. For Instance, learners in schools 

' Witt inser^ice training that concentrated on intergroup relations were 

' , t * • * , 

more likely to favor desegregatioVT, felt that other teachers', attitudes 

^-were al-sd'more ppsitiye,, af\d f^lt more open to express thems^^lves to 
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In schools that had 



their studernfcs on the matter^of. 

* ' ' ••• 
-4>iH>grtniTS''tosIgn^^ help relations between the races wer6 also better 

/ , ' ' . ' \ • 

dlspqs^ to" racially mixed schools, interacg:ed> more with students of 

the 0thef 'race,\and perceived their teachers' as having; more favorable 

att^tw^es to desegregation. Unfortunately, it yas not possible to/ link 

/ ' ' • . \ i' » \ ' I ' * 

ihese two>r6gram .types Ho ESAP; f'the , analysis cirinot dif f erentliatfS b6- ' 

tween schools .where these programs ari funded ^by ESAP apd- school^ where 

they are funded from other • sources 

(4) Some school districts were especially, su^pcessful; t'hje^e, the 

experimental school students did much better ^than the control 

students on an achievement test. There, were also 'some distrl 

'* '1'*' 
the reverse was true. A comparison of these 'two extremes suggested / 

\ I I- ' ' ' ' ^ / 

that the best ^ imp^ementaxioW of ^ ESAP were in faii;^y striall schools, ' 

situated in t*he ^smaller, ruAl .school districts, thi^ maymean that: 

'ESAP*s success is determined jto a degrise by the local setting. 
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